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ABSTRACT 


This dissertation considers optimization problems in which similar decisions need to 
be made repeatedly over many successive time periods. These problems have wide 
applications including manpower planning, seheduling, production planning and control, 
capacity expansion, and equipment replacement/modernization. In reality these decision 
problems usually extend over an indeterminate time horizon, but it is common practice to 
model them using a finite horizon. Unfortunately, an artificial finite horizon may adversely 
influence optimal decisions, a difficulty commonly referred to as the end effects problem. 
Past research into end effects has focused on theoretical issues associated with solving (or 
approximately solving) infinite-horizon extensions of finite-horizon problems.This 
dissertation derives equivalent finite-horizon formulations for a small class of infinite- 
horizon problem structures. For a larger class of linear and integer programs, it also 
develops finite-horizon approximations which bound the infinite-horizon optimal solution, 
thereby quantifying the influence of end effects. For linear programs, extensions of these 
approximations quantify the end effects of fixed initial period decisions over a functional 
range of future infinite-horizon conditions. The bounding methods prove successful in 
eliminating many end effects in two sample applications: A linear program in use by the 
United States Army for manpower planning and an integer program in use by the Defense 
Language Institute for course scheduling. Using as little as two times the computational 
requirements needed to solve a finite-horizon problem, the bounding methods supply 
feasible solutions to the infinite-horizon problems that are guaranteed to be within 1% of 


optimal. 
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I. INTRODUCTION 


This dissertation considers optimization problems in which similar decisions need 
to be made repeatedly over many successive time periods. These problems have wide ap¬ 
plications including manpower planning, scheduling, production planning and control, ca¬ 
pacity expansion, and equipment replacement/modernization. Even though many instances 
of these decision problems extend over an indeterminate time horizon, it is common prac¬ 
tice to model them using a finite horizon. The length of the finite horizon (referred to as a 
forecast or solution horizon), is usually subjective and driven by problem complexity and/ 
or knowledge of data and functional structures. Unfortunately, in many cases, using an ar¬ 
tificial finite horizon adversely influences the optimal decisions: This is commonly referred 
to as the end effects problem (Grinold 1983b). 

Past research into end effects has focused on solving (or approximately solving) an 
infinite-horizon extension of the finite-horizon problem and developing sufficient condi¬ 
tions to ensure that solutions are convergent to the infinite optimal. If the extension to the 
infinite horizon accurately reflects the true problem, generated solutions are optimal (if the 
infinite-horizon problem can be solved directly), or near optimal (if approximation meth¬ 
ods are used) and are not influenced by end effects. This dissertation derives equivalent fi¬ 
nite-horizon formulations for a small class of infinite-horizon problem structures. For a 
larger class of linear and integer programs, it also develops finite-horizon approximations 
which bound any infinite-horizon linear or integer program’s optimal solution, thereby 
quantifying the influence of end effects. For linear programs, extensions of these methods 
quantify the end effects of fixing initial period decisions over a functional range of future 
infinite-horizon conditions. The bounding methods prove successful in eliminating many 
end effects in two sample applications: A linear program in use by the United States Army 
for manpower planning and an integer program in use by the Defense Language Institute 
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for course scheduling. Using as little as two times the computational requirements needed 
to solve a finite-horizon problem, the bounding methods supply feasible solutions to the in- 
finite-horizon problems that are guaranteed to be within 1% of optimal. 

Little has been done specifically to isolate or quantify the impact of end effects (ex¬ 
ceptions being Grinold (1983b), Svoronos (1985), and Schochetman and Smith 
(1989,1991,1992)). Also, only a few examples of infinite-horizon problem structures exist 
for which the form of the infinite-horizon optimal solution is known, thereby eliminating 
end effects (see Grinold and Hopkins (1973a) and Schochetman and Smith(1989,1991, 
1992) for published examples). No research has been conducted to quantify end effects for 
finite-horizon formulations whose future period coefficient structures may vary. This re¬ 
search brings into focus two general approximation methodologies and concentrates on 
identification of quantifiable measures of stability (i.e., minimizing potential end effects) 
for initial decision variable(s), given some functional range of future infinite-horizon con¬ 
ditions. This dissertation is organized as follows: 


•The remaining sections of this chapter introduce infinite-horizon mathemati¬ 
cal programs, illustrating that strong and weak duality conditions are not 
always satisfied. The chapter concludes by highlighting the research contri¬ 
butions of this dissertation. 

•Chapter II provides a detailed review of the separate literatures that exist for 
infinite-horizon linear/convex programs (see Manne (1970), (1976), 
Grinold(1977), (1983a/b), Svoronos(1985)) and for finite/bounded i.e., inte¬ 
ger programs (see Bean and Smith (1984), Schochetman and Smith(1989), 
(1991), (1992)). The methodologies developed by this dissertation use as 
their basis the general solution techniques developed by Manne, Grinold, and 
Svoronos. Two illustrative examples highlight the two approximation meth¬ 
ods used extensively in this dissertation, primal and dual equilibrium approx¬ 
imation and their ability to bound the infinite-horizon optimal objective 
function value. The second general approach is research conducted by Bean 
and Smith (1984), (1985), (1993) and Schochetman and Smith (1989, 1991, 
1992). Their research involves developing methods to generate initial period 
optimal solutions for infinite-horizon bounded integer programs. The authors 
devise sufficient conditions under which solving a finite-horizon formulation 
over a long enough horizon, generates an initial solution that is optimal (or 
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near optimal) over the infinite-horizon. The chapter concludes each section 
by discussing the applicability of each method to the end effects problem. 

•Chapter III derives several simple single period overlap staircase structures 
that have infinite optimal solutions which satisfy the dual equilibrium condi¬ 
tions defined by Grinold (1983b). Since the solution form of the infinite-hori¬ 
zon optimal is known, end effects are eliminated using dual equilibrium 
approximation. 

•Chapter IV lays the basic theoretical background to support the use of primal 
and dual equilibrium approximations to quantify end effects associated with 
infinite-horizon linear and integer programs. Proofs are provided showing 
primal and dual equilibrium approximations have monotonic optimal objec¬ 
tive values over an increasing solution horizon. An example illustrates that 
convergence of dual and truncation approximation methods is possible, even 
when weak and strong duality fail. 

•Chapter V develops the theory and a set of algorithms that quantify the 
impact of a changing right hand side on the initial period optimal solutions 
for infinite-horizon linear programs. 

•Chapter VI applies the primal and dual equilibrium approximations to a real- 
world linear program (a military manpower planning model in use by the 
United States Army). The chapter presents the model, its extension over an 
infinite-horizon, application of primal and dual equilibrium approximations, 
and an extensive computational study. The computational study includes the 
impact of future period growth on initial decisions made under assumptions 
of zero growth. 

•Chapter VII applies primal and dual approximations, which were originally 
developed for use with linear and convex programs, to a real-world integer 
program in use by the Defense Language Institute as a decision aid to deter¬ 
mine instructor requirements and establish course schedules. 

•Chapter VIII summarizes the key theoretical results and insights gained from 
implementation on the two real-world problems, and also provides recom¬ 
mendations for future research. 
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A. THEORETICAL RESULTS 


The main theoretical results of this dissertation are: 

•Showing a class of infinite-horizon problem structures have equivalent finite- 
horizon formulations. These problems can easily be solved providing optimal 
solutions free of end effects. 

•Showing that primal and dual equilibrium approximations, which were origi¬ 
nally developed for infinite-horizon linear and convex programs, can also be 
applied to integer programs. 

•Showing that convergence of the truncation and dual equilibrium formula¬ 
tions to an infinite optimal solution can be achieved even if strong and weak 
duality fail in the limit. 

•Deriving an algorithm that provides a method of bounding the potential error 
associated with using initial decision variables generated under certain 
assumed conditions, when those conditions vary over a functional range of 
values. 

B. PRACTICAL RESULTS 

The practical implications of this research include: 

•Validating the effectiveness of using primal and dual equilibrium approxima¬ 
tions to bound the infinite-horizon optimal solution and quantify end effects 
for a real-world military manpower planning model. Little research has been 
conducted in the last ten years in the use of either primal or dual equilibrium 
approximations. Only Svoronos (1985), in his unpublished dissertation, has 
used both methods together to bound the infinite-horizon optimal solution. 
However, for the manpower planning model examined, the primal and dual 
equilibrium approximation methods prove highly successful in identifying 
and quantifying end effects associated with solving the model over a finite 
solution horizon. 

•Validating the algorithm developed in this dissertation to bound the potential 
error when using specific values of decision variables over a functional range 
of future conditions. 

•Validating the effectiveness of using primal and dual equilibrium approxima¬ 
tion methods to bound the optimal infinite-horizon objective function value 
and to quantify end effects associated with a finite-horizon integer program. 
No work has been found that uses primal and dual equilibrium approxima- 


4 



tions to quantify end effects associated with integer programs. For the integer 
program examined, these methods prove highly successful in identifying and 
quantifying end effects linked to the finite-horizon formulation. 


C. INFINITE-HORIZON MATHEMATICAL PROGRAMS 

This dissertation considers a (countably) infinite-horizon integer or linear program 
MPcc: ■ 


Minimize ^ (x^) 

t = o 


Subject to: 



^ (0, 0) ^^0^ 


= ^0 

^ (1, 0) ^^0^ (7, 7) ^^7) 


= b^ 

^ (2, 0) ^^0^ ^ (2,1) (-*^7) ^ (2, 2) (-*^2) 


~ *2 

^(3,0) ^^0) ^(5,7) (^7) ^(5,2) (^2) ••• 



^ {T,0) ^^0^ ^ {T, 7) ^•*'7) ^ {T,2) ^^2^ 

A j.) (Xj.) 

= bj 


0<x^<Uf (t=0,l,2,...). 

Where: 

• Up Cf, and bf are data vectors of dimensions 1, Ixn,, and m,x 1, t^. 
(It is possible that the dimensionality may vary by period). In addition, we 
can assign, npn, mf=m, for t>l. 

• (X is a discount factor such that (0<a<i). The restriction CL<1 is needed to 
ensure convergence of the objective function. 

•Xf is a decision vector of dimension n,xl, where x, g Z,. c i? ' or 

e Z"' depending on whether the problem of interest is a linear or integer 
infinite-horizon program. 

•cfiXf) (t>0) is a linear function from x^e X, R, that is bounded above 
by an exponential growth function. 
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nif 

• A (, <■) ( a :,.) (t>0,t< t') , is a linear function from XfG -> /( . 

The ideal situation would be to solve the above problem directly, effectively dealing 
with end effects. However; 

•Accurate projections of future data may be difficult if not impossible to 
obtain. 

•Even if accurate projections are available, many infinite-horizon mathemati¬ 
cal programs cannot be solved directly. 

D. STRONG AND WEAK DUALITY OVER AN INFINITE- 
HORIZON 

Any consistent finite dimensional convex mathematical program satisfies strong 
and weak duality (Bazaraa and Shetty (1979)). However, when extended over an infinite- 
horizon, strong and weak duality do not necessarily hold. The following examples illustrate 
the concepts of duality gap (failure of strong duality in the limit) and duality overlap (fail¬ 
ure of strong and weak duality in the limit). 

1. Duality Gap 

The following example, modified from Duffin and Karlovitz (1965), illustrates the 
violation of strong duality {i.e., existence of a duality gap). The primal formulation is: 
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Minimize 

^1 


Subject to 



^1 


>-l 

1 

4 ^ 1 + 

1 

>0 

1 

5 ^ 7 + 

1 

>0 

1 

-X.+ 

n ‘ 

1 

- 2^2 

n 

>0 


Xj e R, JC2 e R. 


The associated dual formulation: 

Maximize —Uj + OU 2 + 0Uj+ ... + Ou^ + ... 
Subject to: 


0 «;+ ^«2 + 


Uj>0 


+- 

n +2 « 


(n + 2 ) 


2 “/*+ 


«„>0 


For any finite-horizon problem (i.e., fix n), strong and weak duality hold for the pri¬ 
mal and dual pair with optimal objective function values equal to -1 {xj=-l and A: 5 =n, Uj=l 

and Uf=0 {2<t^)). As n -> <», the dual formulation maintains the optimal objective val¬ 
ue of -1 with optimal dual decision variables a;=/, Uf=0 (t>2). However, the infimum of 
the primal formulation is zero with xi=x 2 = 0 , as ac; is driven to zero to keep X 2 finite. This 
is a pathological example, since the added constraint X 2 ‘^, for large M, allows strong and 
weak duality to hold in the limit. 
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2. Duality Overlap 

This example, provided by Grinold and Hopkins (1973b), is a linear program that, 
when expanded over an infinite-horizon, exhibits a duality overlap. 

The primal formulation is: 



Maximize Uq + Vq 
S ubject to: 

u^-2v^_^j<0fort=0,l,2,...n-l (1) 
v^-2u^_^j<0 for t=0,l,2,...n-l (2) 

(3) 

< 0 (4) 

V, fort=0,l,2,...n. 

For any horizon, an optimal primal solution with objective function value of zero, 
is jP _ 2 f^ z-o (t=0,l,2,..-n). For any finite n, dual constraints (3) and (4) result as special 
cases of constraints (1) and (2) when t—n, (i.e., v „+7 and «„+; do not exist for any finite 
formulation). For finite n, the optimal dual solution with objective function value of zero, 
is v,=M,=0 (for all 0<t^). However, in the limit as n ^ «>, the dual formulation no long¬ 
er includes constraints (3) and (4) and = V, = ^ 2 ^ (for all t=0,i,2,5,...) is feasible 
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with an objective function value of 2. Therefore, in the limit, a duality overlap of 2 exists 
between the primal and dual formulations’ optimal objective function values. 

E. SUMMARY 

For both the special cases presented in the last section, strong and/or weak duality 
fail in the limit (as n -4 «>). As illustrated in later sections, while this is an interesting 
theoretical problem, the bounding techniques developed to eliminate and/or quantify end 
effects work even when strong or weak duality are not satisfied in the limit. 

The next chapter provides a detailed review of the separate literatures that exist for 
infinite horizon linear/convex programs and for finite/bounded programs. 





11. BACKGROUND 


This chapter provides a detailed review of the separate literatures that exist for in- 
finite-horizon linear/convex programs (Manne (1970), (1976), Grinold(1977), (1983a/b), 
Svoron6s(1985)), and for finite/bounded programs (Bean and Smith (1984), Schochetman 
and Smith(1989), (1991), (1992)). The focus of this review is the applicability of these 
techniques to cope with end effects. 

Section A provides a review of five approximation methodologies developed for in- 
finite-horizon linear programs {Truncation, Salvage, Fixed End Conditions, Primal Equi¬ 
librium, and Dual Equilibrium) illustrative examples highlight some of the properties 
associated with the primal and dual equilibrium approximations. 

Second B extends the concept of using primal and dual equilibrium approximations 
to bound the infinite optimal solution for infinite-horizon convex programs (Svoronos, 
1985). A simple example illustrates the effectiveness of the bounding methodology pro¬ 
posed by Svoronos and developed independently by the author. 

Section C reviews research conducted by Bean and Smith (1984), (1985), (1993) 
and Schochetman and Smith (1989), (1991), (1992). Their research involves developing 
methods to generate initial period optimal solutions for infinite-horizon bounded integer 
programs. The authors devise sufficient conditions for which solving a truncated formula¬ 
tion over a long enough horizon, generates an initial solution that is optimal (or near opti¬ 
mal) over the infinite horizon. 

The last section of this chapter concludes that together primal and dual equilibrium 
approximations show the greatest promise for practical implementation. Follow on chap¬ 
ters expand on issues associated with practical implementation of primal and dual equilib¬ 
rium approximations to quantify end effects for both infinite-horizon linear and integer 
programs. 
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A. INFINITE HORIZON LINEAR PROGRAMMING AND END 
EFFECTS 

When Xf is a real valued vector, (i.e., a member of r"' ), the infinite-horizon math¬ 
ematical program is an infinite-horizon linear program (hereto defined as LP°°). Research 
into solving and understanding the underlying structures of LPoo has been conducted by 
Manne (1970,1976), Hopkins (1971), Grinold and Hopkins (1973a), Grinold (1971,1977, 
1983a^), Murphy and Soyster (1986), and Romeijn, Smith, and Bean (1992). The purpose 
of this chapter is to summarize the results of past research in this area and highlight the ap¬ 
plicability of such work to end effects when the original problem can be formulated as a 

LPoo. 


1. Approximation Methods 

Grinold (1983b) identifies five general approximation techniques (Truncation, Sal¬ 
vage, Fixed End Conditions, Primal Equilibrium, and Dual Equilibrium), that can generate 

finite-horizon approximations for LPoo . 

a. Truncation 

Truncation approximates the LPoo by dropping constraints and cost coeffi¬ 
cients tied to the variables {t^T+1). The following is a truncation approximation of 
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T 

Minimize ^ 
t = o 


Subject to: 



^(0,0)^0 

IV 

(0) 


>bi 

U) 

^{2,1)^!'^ ^(2,2)^2 

>b2 

(2) 

^{3,0)^0'^ (3,1)^1'^ ^(3, 2)^2'^ ^(3,3)^3 


(3) 

^{T,2)^2'^ ^{T,3)^3'^ •• 

■ ^ T) ^ T ^ I' 

(T) 

0<X^<U^ 

(t=0,l,2,...). 


Truncation disconnects the first T period decisions from the rest of the prob- 


lem. The form of disconnection assumes that resources created up to time T have no value 
after period T. This can lead to end effects where either the initial decision variable(s) are 
suboptimal, or worse, infeasible over LPoo. Truncation is effective at eliminating end ef¬ 
fects over the initial decision(s) jcq, when there exists an F such that for all {T>F), the opti¬ 
mal initial decision variable(s) for the T period truncation, x/ are optimal for LPoo. The 
difficulty lies in determining under what conditions one can guarantee that a finite F exists. 
Assuming sufficient conditions exist for weak and strong duality for a LP°° (i.e ., Romeijn, 
Smith, and Bean (1992)), the cluster points (as T -» oo) of the sequence {x/} form a set 
of optimal points for LP°°. However (as subsequently shown in section A.2), there is no 
assurance in general of the existence of a finite forecast horizon F, such that if , and the 

truncation problem is solved, the resulting Xq^ is optimal to LPoo . 

The truncation method has the property that given for all t>T, the opti¬ 
mal objective function value to the tmncated problem is a lower bound to the optimal ob¬ 
jective function value of LPoo . 
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b. Salvage 

The salvage technique extends truncation by placing a future value on re¬ 
sources carried over into later periods {salvage value). The model formulation is very sim¬ 
ilar to truncation except the objective includes salvage values that represent the per unit 
value of in all future periods not explicitly modeled (Le., periods T+1, T+2, T+3,...). 

T 

Minimize CL {c^-d^)x^ 

t = 0 


Subject 

to: 





^0^0 




II 

0 

(0) 

HjXq 




= *7 

(1) 

^2^0 

+KiXi 

+AX2 


II 

(2) 

^3^0 

+K 2 XJ 

+K 1 X 2 

+AXj 

II 

(3) 

HfXo 

1 

+ 

+ Kj. _ 2^2 

. . . 

+Axj. = bj 

(T) 


0<x^<upf (t=0,l,2,...,T). 

Grinold (1983b) uses Lagrange multipliers to relate the infinite-horizon and 
salvage linear program formulations. Grinold starts with the LPo° problem: 
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oo 


Minimize ^ a 
t = o 

Subject to: 


^0^0 



= bQ ( 0 ) 

HjXq +AAr j 



= bj (i) 

H2X0 +KjXj 

+AX2 


= b2 ( 2 ) 

H3X0 +K2XJ 

+KjX2 +AX3 

= ^ ( 3 ) 

HjXq +Kj,_jXj 

■\-K-p_ 2^2 

... 

+Axj, = bj. (T) 


0<Xj<upj it=t 

0,1,2,...). 


Grinold ( 1983 b) uses Lagrange multipliers a,, to formulate LPo° as: 

00 

^ . 1 

f 

t-i \ 

Minimize V CLc^x^ + V a 

bj-HjXQ- 


t = o 

t=T+I 


n = l '' 

Subject to: 




^0^0 



= bQ ( 0 ) 

HjXq +AXj 



=bj (1) 

H2X0 +KjXj 

+AX2 


= b2 ( 2 ) 

H3X0 +K2XJ 

+KjX2 

+AX3 

= b^ ( 3 ) 

H J^XQ '\‘Krp ^ jX J 

'\~FkjQ_ 2^2 

. . . 

+AXj = bj. (T) 


0<Xf<upf (t=0,l,2,...). 

Grinold ( 1983 b) illustrates that if: 

oo 

^ a , 

t=T+l 
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d.= ^ a (l<j^) ;and 

t = T+l 

oo 

dj = UjA + ^ o'Uf (j>T+l). 

t = i 

Then the objective function: 

oo 00/ t — 1 ^ 

Minimize ^ac^x^+ ^ au^ b^-H^Xg- ^ K^_^Xn-Ax^ can 

t=o t=T+l ^ n=l ' 

be rewritten as: 

J’ 00 00 

Minimize {c^-d^)x^+ ^ a (c^-d^)x^+ ^ aufi^. 

t=o t=T+l t=T+I 

The salvage technique uses the first term and ignores the last two terms of 

the reformulated objective function. Grinold (1983b) further shows that 

T' 00 00 

Minimize a x^ + ^ a {c^-d^) x^+ yields a lower bound 

t=0 t=T+l t=T+l 

on the optimal value of the infinite horizon problem provided the following assumptions 
hold: 

•Given any set {U(},df (for all t) exist; 


•The sum X “ exists; and 

t = T+I 

•The optimal solution jTj* t>T+l of 
Minimize (c^ - d^ x^ 
Subject to: 

0<Xf<up^ 

exists for all t>T+l. 
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A difficulty with using the salvage method lies in determining a-priori the 
proper salvage values {rf,} or Lagrange multipliers {«,}. Grinold (1983b) illustrates that 
under the above assumptions, given any set of Lagrange multipliers {«t}. an optimal solu¬ 
tion xx*) to the salvage approximation provides a lower bound to 

LPoo (as defined in this section). However, the quality of any solution is dependent on the 
a-priori•choice(s) for and {m,}. Therefore, it is impossible in general to quantify the 
end effects of any derived optimal solution set using salvage techniques. A poor choice of 
{df] and {mJ can lead to greater end effects difficulties than those created by the truncated 

solution approach. 

c. Fixed End Conditions 

Another typical approach to deal with LPoo, is to solve a finite period prob¬ 
lem, fixing the desired end conditions. The formulation is very similar to truncation, how¬ 
ever, it includes one additional constraint (representing the tie-in to all future constraints). 


T 

Minimize ^ cdc^x^ 

t = 0 

Subject to: 

^ U , 0 )^ 0 '^ ^ { 1 , 1)^1 


^^0 

>b, 


^(T + 1, T)^T 


>bj. 

-^T+l~^{,T+l,T + l)^T+l 

jc. > 0, (0<i^) 


Given a staircase problem structure and a-priori the infinite optimal value of 
A (J .+, 7 .+ j , solving the above formulation provides an infinite optimal solution for the 
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variables Xq, Xj, X2,... Xj. Consider the following example: 


00 

Minimize ^ {0.9)‘x^ 


t = 0 


Subject to: 


Xq 

>1 

Xo+ Xj 

>1 

Xj+ X 2 

>1 

X 2 + 

>1 


x^>0 {t=0,l,2,3...). 

For this example the optimal solution is Xf=l (t=0, 2, 4,...), Xf=0 (t=l, 3, 
5...). (See chapter III section A for a proof that problems with this structure have optimal 
solutions of this form.) 

Using JCj=0, the problem can be formulated as: 


ily solved: 


CX3 

Minimize ^ (0.9)^x^ 
t = o 

Subject to: 



>1 

>1 

>1 

>l-{x^ = 0) 

>l-{Xj = 0) 
>1 


Note that the problem is separable, which allows for Xq,Xj, and X2 to be eas¬ 
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'Minimize {Xq + 0.9xj + 0. 81 x 2 ) 
Subject to: 


^0 

Xq + Xi 


>1 

>1 


Xj+X2'^l 

X2>1 


Xq,Xj,X2>0 


Minimize ^ (0.9) ^x^ 


t = 4 


Subject to: 


x^+ x^ 


^5+ 


^6+ 


x ^>0 


>1 

>1 

>1 

>1 


Solving the finite-horizon problem on the left provides an optimal solution of Xq=1, X]=0, 


X2=l. 

Fixing end conditions assumes that the infinite optimal solution has as part 
of its optimal solution set, . Of course, the difficulty lies in identifying an 

optimal xj^i. For linear programs, the number of feasible values for Xj+ j is in general un- 
countably infinite (a special case however, exists when only one point arj+y is feasible over 
the infinite-horizon problem space). While in theory it is possible to address this issue, 
(Schochetman and Smith (1989, 1991, 1992)), the approach in general is plausible only 
when there exists some period T+1 for which JCj +7 has only a manageably finite number of 
possible solutions. Using this method with a suboptimal end condition produces an unwant¬ 
ed end effect whose influence cannot be easily measured. 
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d. Primal Equilibrium Approximation 

Manne (1970,1976) proposed an approximation to LPo° that assumes there 
exists a time period T, such that for all t>T,Xi^i='kx^ (i.e., the decision variables after a fixed 
period become functionally related). Grinold (1983b) refers to this as Primal Equilibrium 
approximation. Svoronos (1985) further expands this definition to be any restriction on the 
feasible region, such that a finite period re-formulation is possible. For the purposes of il¬ 
lustration, we restrict ourselves in this section to restrictions posed by Manne. The primal 
equilibrium approximation requires the following assumptions: 

•Ct=c<M, t>T; 

•Xa<l (Needed for objective function convergence); 

•There exists an L such that for all {Q<t<t’) (implying any 

decision variable x, links only a finite number of constraints); 

•There exists a I such that ^)=A, (where t>T); 

•Aq is the lower triangular matrix structure associated with the variables Xq, Xj, 

X 2 ,...XT’.; with dimensions [{mQ+mj+m 2 +...+mj.j) x {nQ+ni+n 2 +...+nj.j)\, 

•H,={A(,o),^(r. 7 ).>l(f, 2 )’-^a 7 ’-/)} with dimensions [(m,) x («(,-l-n;+« 2 +- 

+W7’-7)] 

•bf+i=0J)f (t^T) (ensuring non-empty primal feasible region when Xf+j=Xxf. 
Figure 1 shows the general form of LP°o satisfying the above conditions: 
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oo 


1 

Minimize cXq + a 

t — T 



Subject to: 

t = T 



^0^0 


/V 

” ^0 

(0) 

HjXq+ Axj 


II 

(1) 

H2Xq-^ K^Xj+ 

Axt + 1 

II 

(2) 


^^T + 2 

= xhr 

(3) 

HjXq+ Kj^_jXj.+ 

^L-2^T+1'^ ^L-3^T + 2'^ " 

1 

11 

1 

+ 

H 

(L) 

KjjXj-+ 

^L-I^T+l'^ ^L-2^T + 2 


(L+7) 


^L-1^T + 2 

• 



Figure 1. 

Xf>0 {t=0,T,T+l,.. 

.) 


General form of LP«> formulation for which 
primal equilibrium approximation is applicable. 


Where Xg is the aggregated vector (xq, Xj, X 2 , Xs,...Xj.i) and c is the vector (cj, (XCi, 0 ?C 2 , 
o^C 3 ,...,aF'^CT.i), and bo is the vector Qjq, bj, b 2 , bs-bj-.j), (with dimensions 
{n;+n 2 +»j+- +»r-i} x 7, 7 x {nj+n 2 +n 3 +... +nj.j} and {m;+»i 2 +mj+... +mT.j} 

X 7). When x^+j is restricted to Xf+]=XXf for f>T, the above structure allows an equiva¬ 
lent finite period formulation. For example, consider L=7. The constraints from period T 
onward (i.e., equation (3) onward in Figure 1) become redundant. Substituting Xf+]='kXf 

for t>T, the objective function can be re-written in terms of Xg andxf. 


T 

cxq + a 


- T) 

a 


At-T) 

A, cXj.. 


t=T 

If L>7 and A=l, then adding the functional constraint set Xf^.i^=Xf, t>T, k finite leads to a 
finite period reformulation as the constraint set again eventually becomes redundant. 
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Primal equilibrium approximation has the following properties. (The prop¬ 
erties are formally proven in Chapter IV). 

•Primal equilibrium approximation adds constraints (i.e., restrictions) to the 
original primal feasible region. Therefore, any primal equilibrium 
approximation optimal solution is an upper bound to the LPo= optimal 
objective function value. 

oo 

•Let } be an optimal solution to the primal equilibrium approximation 

t = 0 

where jc, These decision variables form a feasible solution 

sequence to the LPoo problem. 

The primal equilibrium approximation assumes a T exists where a function¬ 
al relationship can be derived that restricts the feasible region and leads to a finite period 
re-formulation. If this functional relationship holds for an optimal solution to LPc=o, and T 
is known, end effects are eliminated. The difficulty lies in determining a-priori if the prob¬ 
lem structure has an infinite optimal sequence where the functional relationship holds. 
Manne (1970) derived a set of sufficient conditions under which primal equilibrium func¬ 
tional relationships exist in optimal primal solution sequences. If an optimal solution does 
not exist satisfying the functional relationship, the optimal solutions to the infinite horizon 
formulation may be severely impacted. Even in such circumstances. Chapter IV shows that 
primal equilibrium approximation provides an upper bound on the optimal objective func¬ 
tion value to LP°o. It is important to note, that even if primal equilibrium approximation 
converges to the optimal solution for LPoo , this does not necessarily imply the existence of 
a finite forecast horizon F, such that if k=F, and the primal equilibrium approximation is 

solved, the resulting is optimal to LP°° for any t (0<t<F). 

e. Dual Equilibrium Approximation 

Dual equilibrium approximation (see Grinold (1971, 1977, 1983a/b)), 
solves LPoo by aggregating constraints of the original problem, in a manner that allows re- 
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formulation of LPoo as a finite-horizon linear program. Dual equilibrium approximation 
provides solutions for LP®® problems with the following general structure; 

oo 

Minimize cXq + a^ ^ (X 
t = T 

Subject to: 






>bo 

(0) 

HjXq+ 

AXj 



IV 

(1) 

H2XQ+ 


Axt^i 


IV 

+ 

(2) 

H3X0+ 




-^T + 2 

( 3 ) 



+ ••• 

^^T+L-l 

~ ^T+L -1 

(L) 




Axt^l 

~ ^T + L 

(L+ 1 ) 

0<Xq<Uo 


0<x^<u^ {t=l,2,...) 





The following conventions are used: 

• JCo, is the aggregated vector (xq, x /, X 2 , Xj, X 4 ,...^j.{), (with dimensions 
(nQ+nj+n 2 -^—+nj_j) x 7 )i 


•c is the vector (cq, axj, a?C 2 , (with dimensions 

1 X {nQ+nj+n2+--‘+nji])y, 

•Cf=c for all t>T; 

• bo is the aggregated right hand side (bg, bj. b 2 . 65 ...., 67 -.;), (with dimensions 

(inQ+mj+m 2 '^--- x 7). 

In addition, the following functional relationships must hold; 

;)=A (for all t>T), A =Kj (whevcj=t-t\ t>t',t> T); 

• Aq is the lower triangular matrix for variables Xq,Xj,X 2 ,..-Xj.j with 
dimensions [(OTo+wi;+m 2 +...+/W 7 -. 7 ) x {nQ+ni+n 2 +...+nj.j)\‘, 
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A(t,l)’ ^(t,2)’--^(t,T-l)} with dimensions [(/w^) x 
{{nQ+nj+n 2 +---+fij_])] {t^-iy, and 


•The infinite sums b^= ^ a” , H^= ^ a” , 

n=T n=l 


A 


a 


oo oo 

A + 2 aK^, and = X - “a ^ ~ 

n=] n=T 


Aggregating all constraints from time T onward under the condition that the jth constraint 
(j>l) multiplied by leads to the following formulation: 

T 

Minimize cXq + a cx^ 



Dual equilibrium has the following properties: 

•The optimal value of the dual equilibrium relaxation is a lower bound on the 
optimal value of LP°o . Aggregating the constraint space is a relaxation of the 
original feasible region, therefore, the derived optimal solution cannot be 
worse, {i.e., the set of feasible solution sequences for LPoo is a subset to the 
set of feasible solution sequences for the dual equilibrium approximation). 
Chapter IV contains a proof. 


•Define xl, x^ as optimal solution values to the relaxation where the 
aggregation of constraints begins at period T. Note that 
xl = xl, x], xl, x], ...xl_i are feasible to the first T-1 constraints of LPo° 


•If the value of the optimal objective function for the dual equilibrium 
problem converges to the optimal objective function for LPoo then for all 

finite teZ^, there exists a subsequence SfCZ*, such that for keSj 


j. -^x,* , where xj^ is an optimal decision variable for a k period 
approximation and Xf* is an optimal decision variable for LP<=° (See 
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Grinold(1977, 1983), Svoronos (1985), and Romeijn, Smith, and Bean 
(1992)). 

Dual equilibrium approximation aggregates constraints from period T+1 
onward. The effect of this aggregation becomes clearer if one looks at the equivalent for¬ 
mulation one can obtain using Lagrange multipliers. Given LP<», placing the constraints 
from period T+1 onward into the objective function with their associated multipliers, and 
assuming that the multipliers have the functional relationship that j=mi^ {t>T+l), leads 
to an objective function with only one multiplier for the aggregated discounted summation 
of all constraints beyond T+1. Dual equilibrium approximation, when applicable, indicates 
that the value of future resources is functionally tied and decreasing at a constant rate. If an 
optimal solution to the original infinite horizon formulation has this underlying functional 
relationship, solving the dual equilibrium reformulation with the proper value of T pro¬ 
vides an optimal :t:o for LPoo. Grinold and Hopkins (1973b) identify a class of problems in 
which an infinite horizon optimal has the dual equilibrium functional relationship. Howev¬ 
er, this class is by no means inclusive (See Chapter III for additional examples). Difficulties 
exist in determining a-priori if the problem structure has an infinite optimal sequence where 
the associated multipliers have the functional relationship U(^j=aut {t>T, T finite). Even if 

no optimal exists to LP^ with this functional structure, dual equilibrium approximation 
still provides a lower bound on the objective function (see Chapter IV), however, the opti¬ 
mal decision variables have the potential of being infeasible for the infinite horizon prob¬ 
lem of interest. If sufficient conditions are met which ensures that the dual equilibrium 
approximation converges to an infinite horizon optimal, (^.g.,Grinold (1977)), then for all 

finite asT there exists a subsequence S, c Z*, such that for k e Sf, 

where is an optimal decision variable for a k period dual equilibrium 
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formulation, and x^* is an optimal decision variable for LP<>°. This does not necessarily 
imply the existence of a finite forecast horizon F, such that if k=F, and the dual equilibrium 
problem is solved, the resulting is optimal to LPoo for any (0<t<F). 

2. Primal and Dual Equilibrium Examples 

The following two examples illustrate the concepts and potential shortcomings of 
the primal and dual equilibrium approximations. 

a. Primal Equilibrium Assumptions Satisfied 

In this example LPco, an optimal sequence exists that satisfies the assump¬ 
tions associated with primal equilibrium. 

The LPoo of interest is: 

oo 

Minimize ^ (0.9) ^x^ 
t = o 

Subject to: 

='' 

x^>0 (t=0,l,2,...). 

Property /: This formulation has only one feasible (and therefore optimal) solution 

0.899 . 7 o 5 ^ 

for all (t^O, 1, 2, 3,...). 
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0 899 

Proof: Clearly ^t=f'^ feasible since for all (t=0,l,2,3,...) 


1 ¥ 0 . 899 ^ ^ 0.899 ^ j 


0.899^‘-^'^^^ yo.899AL899) 1.899 


The proof shows by contradiction that this is the only feasible solution. As¬ 
sume there exists some feasible sequence {Ji^/}, = o such that for some t. We first 

show that it is sufficient without loss of generality to consider only where 


X, > . We then show Xt+ 2 >Xt and JC,+ 2 -JC/= 1 - + 


0.899 yy 0.899 


1 Xf. Using this 


result, it can easily be shown for any finite n>l that Xf+2n+2>^t+2n and 


Xt+2n+2-^t+2n ^ 0.899^ Ao.899 


1 x,+ 2 n • This relationship provides a contradic¬ 


tion since (jc, < ...) for (n=l,2,3...) grows without bound and Xt<0.899 


for all t 


0.899 


Xt+x, + , = l and x„Xt^,>0\. 


0.899 


We first show that xf>Xf.j implies xf>Xt+j and x, > ■ If x^Xf.j, then 


X, > since x,_, = x-5, (0 < 5 < 0.899) which implies (x, - 8) + x, = i 

1,899 u,oyy 


or = ^-^99 + 8 g. _ _I_ (£ > 0) , this implies 

' 1.899 1.899 ‘ 1.899 


1 f 0.899 


0.899y 1.899 


+ £ +Xf^j — 1 Xf^j — 


1.899 

0.899 e 0.899 
1.899 0.899 1.899 


orxp»x,+ 7 . From 


Xf.]<Xt>Xt+] it should be clear that it is sufficient to only consider xp>Xf.j 

Therefore, without loss of generality consider xp»x,.;, and note that 


> 9:^22 .. Now examine the relationship between x ,+2 and x,. Since 
1,899 


0.899 


X, + X,^j = l X, 




0.899 
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fore optimal) solution is jggg (t=0,ly 2,...). 

QED (Property I) 

Applying the primal equilibrium approximation (applying the additional 
constraints xj=X 2 =X 3 ...) the problem reduces to: 

Minimize Xq + 9Xj 
S ubject to: 

^"" 0 + = i 

1.899 _ j 

0 . 899 ^^ 

Xq,Xj>0 

This formulation has an objective function value of approximately 4.734 
withA:o,jC; = = 0.4734, which are optimal for the infinite horizon problem. This prob¬ 


lem exhibits some interesting characteristics: 

•Solving the original formulation using truncation approximation techniques, 
given a forecast horizon T, yields a solution x^, (0<t<7) which is not optimal 
to LPoo . The sequence of objective function values and optimal decision 
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variables (as !->«>) from the truncated approximation are convergent 
(Romeijn, Smith, and Bean (1992)) to the optimal values for LRoo, however, 
there exists no finite forecast horizon T under which , for any (0^t<T) is 
optimal to LPoo. 

•Solving the original formulation using dual equilibrium approximation 
techniques, given a forecast horizon T, yields a solution X( , (0<t<T) which is 
■ suboptimal to LPo°. The sequence of objective function values and optimal 
decision variables (as T oo) from the dual equilibrium approximation are 
convergent (Using results of Romeijn, Smith, and Bean (1992), and Grinold 
(1983)) to the optimal values for LP<=o , however, there exists no finite 
forecast horizon T for which for any (0<t<I) is optimal to LPoa. 

b. Dual Equilibrium Assumptions Satisfied. 

The following simple example of LP^o has an optimal solution sequence 
that satisfies the dual equilibrium assumptions. 

oo 

Minimize ^ {0.9)^x^ 
t = o 


Subject to: 



^0 

>1 

(0) 

0.8xq+ Xj 

>2 

U ) 

0.8xj+ X2 

>2 

(2) 

0.8X2+ ^3 

>2 

( 3 ) 

x^>0 {t=0,l,2...). 




Applying dual equilibrium method with a=0.9 (aggregating with/discount¬ 
ing constraints (2) onward) generates the following dual equilibrium approximation. 
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Minimize Xq + 0.9xj + 0.81x2 
Subject to: 


O.SXQ-i" 


0.8xj+ 1.72x2 >20 


Xq,Xj,X 2 > 0 . 

This approximation has an optimal objective function value of 11.0465 with 
X(^l, X]=l.2, and JCj =11.0698. This problem is an example of the structure (See 

i-l 1-2 

Chapter III). If one uses the formula or,. = X; X (-^)' (P)' + (P) * S®"" 

(=0 t=o 

erate x^ {f>2) with p=0.8, and a: ; and Xq are optimal solutions to the truncated formulation 
(which equals the values of the dual equilibrium formulation), the following formula is de¬ 


rived: 


t ^ 

a:. = 2]^ {-1)^0.8* + 1.2 {-1)'~\0.8)'~^ i>2 


It can be shown that the above formula generates feasible points to LP«>, 


and that: 


X2= X « = 11.0698. 

t-2 

This sequence is feasible io LP<>°, yet provide the optimal solution to the re¬ 
laxed formulation. Therefore, xq, and a:/, the optimal solutions to the relaxed formulation, 

are also optimal to LPo°. 


3. Summary 

All of the approximation methods discussed have potential pitfalls regarding end ef¬ 
fects. The truncation method, completely disregards future requirements, and the other 
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methods discussed, (salvage, fixed end conditions, primal, and dual equilibrium) all rely on 
assumptions regarding the infinite-horizon, that usually cannot be verified. However, pri¬ 
mal equilibrium approximation always lead to upper bound optimal objective function val¬ 
ues for LP°o, and dual equilibrium approximation always lead to lower bound optimal 
objective function values for LP°° (See Chapter III for a formal proof). Therefore, as the 
next section illustrates primal and dual equilibrium approximations together can provide a 
tight bound for the infinite horizon optimal objective function value. This provides an ef¬ 
fective way to measure any remaining end effects with the optimal decision variables asso¬ 
ciated with the primal and/or dual equilibrium approximations. 

B. INFINITE HORIZON CONVEX PROGRAMMING 

When Cf is a continuous convex function, ,-)(x^) is concave where Xf is a real val¬ 
ued vector {i.e., a member of/?") and is a real valued vector, MP«> becomes an infinite- 
horizon convex program S voronos (1985) conducted research in the areas of duality 

theory and finite-horizon approximations for a general class of infinite-horizon convex pro¬ 
grams, for which the constraint space is staircase in nature (i.e.,the concave period t con¬ 
straint function depends only on variables associated with either period t or t+1) ^ The 
general form of the problem follows introduction of notation, as used by Svoronos: 


Indices: 

t 

Time Period {0,1,2,3... T-1, T, T+l...). 

Data: 

a 

Discount Factor {0<a<l); 


n(t) 

Dimension in period. 

Decision Variables: 

Xt 

period current production vector with dimensions 



n(t) X 7; 


'•Extension of contributions by Grinold (1977,19833^), Manne (1970,1976), Evers (1973,1983), 
among others. For a complete listing, see Svoronos (1985). 
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yt+i 

r* period lagged production vector with dimensions 

n(t+l) X 1. 

Decision Space: 

St 

feasible set of decisions y^^ j). 

Functionals: 

Gt 

Closed proper concave function R\ 



Closed proper convex function R; 


ht 

Proper convex function R"^^^ R', 


gt 

Proper concave function R. 


Infinite Horizon Convex Program: 

oo 

Minimize ^ OLU^ (x^, y^ + j) 
t = o 

Subject to: 

so(yo^ ^soiyo^ 

G,ix^,yt^i) >0 (0<t<o^) 
h^ix^) <g^iyi) (0<t<oo) 

+ (0<t<oo) 

where yg is given. 

It is important to note that this convex structure is general in nature, and includes as 
an important subset single period overlap staircase structured linear programs. A non-lin¬ 
ear example of this general program structure used by Svoronos (1985) follows: 
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Example Problem Formulation: 


Minimize ^ (-1) alogx^ 
t = o 

Subject to: 

ak\>x^-¥yf (0<t<oo) 

K+i = K-^yt (o^t<oo) 

Icq given 

k^,yf,x^>0 (0<t<o=) 

a>0,0<b< 1. 

For any finite forecast horizon T, this problem involves minimizing a strictly con¬ 
vex function over a convex feasible region. Therefore, for any finite forecast horizon T, the 
optimal solution represents a unique global minimum (Bazaraa and Shetty (1979)). 
Svoronos (1985) illustrates when given certain regularity conditions, the solution of the in- 

finite-horizon convex program also has a global minimum . 

Convex programs, of which linear programs are a special subset, have, as a rule, an 
uncountable number of possible end conditions for any finite horizon. Because of this, there 
is no assurance in general for the existence of finite forecast horizons (i.e., a forecast hori¬ 
zon rfor which a subset of the optimal decision variables to the T period approximation 
are optimal to the infinite-horizon problem). However, Svoronos (1985) illustrates for a 
general staircase structure convex program, (given certain assumptions are met), that Tpe¬ 
riod finite horizon approximations generate a sequence of optimal objective function values 
that converge in the limit to the infinite optimal. He also shows under the same assumptions 
that a subsequence of the optimal decisions generated by the T period finite-horizon ap¬ 
proximations converge point-wise to an infinite optimal. 


Svoronos used an equivalent class of problems, where the problem was to maximize a concave 
objective over a convex region. 
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1. Bounding Methods 

Svoronos (1985) was the first to propose using a generalization of the primal and 
dual equilibrium approximations to bound the optimal objective function value for the in- 

finite-horizon problem.^ For infinite-horizon convex programs, no finite horizon T exists 
in general for which the optimal decision variable(s) for any (0<t<T) are optimal 

for the infinite-horizon problem. If the objective function can be bounded by use of approx¬ 
imations which have finite-horizon formulations, then the difference between these approx- 

imations can be used as a measure of quality for the decision variable(s) {Xf , ) as 

compared to the optimal + 7 ) for the infinite-horizon problem. The general algorithm 
is; 

• Step 1. Set initial forecast horizon T Set tolerance level £. 

• Step 2. Apply variation of primal equilibrium approximation to the convex formulation. 

Add functional restrictions as needed to make all constraints which include decision vari¬ 
able Xr+j onward redundant. Evaluate restricted formulation. Note optimal objective value 

Z(TRestrict) j optimal initial period decision(s) jc Note that is feasible 

to the original formulation. 

• Step 3. Apply variation of dual equilibrium approximation to convex formulation. Aggre¬ 
gate/with discounting all constraints which include variables ATT'+y onward. Evaluate 

relaxed formulation. Note optimal objective value Z and optimal period decision(s) 

^ TRelax may not be feasible to original formulation. 

• Step 4. Evaluate Z (^Restrict) _ ^ (TRelax) jf tjjg difference is less than 8, stop. Use x 
as your choice as an £-optimal X(. Otherwise, increment T, and return to step 2. 

As long as the objective function values of both the primal and dual equilibrium ap¬ 
proximations converge to the infinite optimal objective function value, this algorithm 


This idea was developed independently by the author prior to finding Svoronos (1985) unpub¬ 
lished dissertation. The concepts are an extension of work done primarily by Grinold (1977, 
1983), and Manne (1970,1976). 


34 



provides a near optimal solution for the decision variable(s) of the infinite-horizon prob¬ 
lem. Figure 2 illustrates this idea. 



Figure 2. 

Bounding the objective function. 


2. Using Bounding Methodology 

This section illustrates how the above bounding algorithm can be used for a specific 
problem. 

Let’s examine the following linear program: 


oo 

Minimize ^ (xcx^ 
t = o 

Subject to: 

Axq ^s(O) 

KXq+ AXj ^bil) 

Kxj+ Ax 2 ^b{2) 

Kx2+ Ax^ '^b{3) 


x^>0 {t=0,l,2...). 

Applying primal equilibrium approximation to the above formulation at period T 
(i.e., setting Xt=Xf+j for t>T) results in the following finite period approximation: 


35 




T-J ^ 

f a cxj 

Minimize > a cx. + —- 

^ ' l-a 

t = o 

Subject to: 

Axq 

Kxq+ Axj 

Kxj+ Ax2 


>s{0) 

>b(l) 

>b(2) 


Kxj_j+Axj ^b{T) 

{K + A)Xj, >b{T+l) 

x^>0 (t=0,l,2...,T). 


Applying the dual equilibrium approximation to the original formulation from pe¬ 
riod r onward (aggregating constraints T onward discounting with factor a) results in the 
following finite period formulation: 

T-I 

^ J' 

Minimize ^ oc cx^ + a cx^ 
t = o 

Subject to: 



>s(0) 

>b{l) 

>b{2) 


Kxj._2'^ ^^t- 1 >b(T-l) 

Kxj,_j+ iaK + A)x^ 
x^>0 (t=0,l2,...,T-l) x^>0. 

Increasing the solution horizon for each of the above approximations (i.e., in¬ 
creasing 7), leads, in many cases, to a sequence of optimal objective function values 
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which form a convergent sequence for both primal equilibrium and dual equilibrium 
approximations. Chapter IV discusses the issue of convergence in detail. A specific exam¬ 
ple uses: 

^ ^ \l.O 1.0 1.0 . 

[o.O 1.0 O.Oj ’ 

^ ^ Fas 1.5 0.8 . 

[o.O 1.2 0.o\ ’ 

c = (1.0, 3.0, 2.oy, 
s = (1.0, 2.0); 
b = (13.0, 5.0); 
a = 0.9; 

Applying both primal and dual equilibrium approximation generates the bounds shown in 
Figure 3: 



Figure 3. 

Convergence of bounding methodology. 



3. Summary 

Svoronos (1985) shows that the generalization of the primal and dual equilibrium 
approximations, when applied to a class of convex formulations, converge to the infinite 
optimal solution as I tends toward infinity. Svoronos requires several conditions be veri¬ 
fied to ensure that the objective functions of the primal and dual equilibrium approxima¬ 
tions converge to the same value, and therefore converge to a infinite horizon optimal. 
However, the more practical result is the bounding algorithm. Using both primal and dual 
equilibrium approximations, it is possible to bound the error associated with using either 
approximations decision variables. Therefore, if the infinite-horizon problem structure is 
completely defined, this bounding methodology provides a method to eliminate many of 
the end effects associated with finite-horizon formulations and link any remaining end ef¬ 
fects that exist with the primal or dual approximations to the size of the gap between their 
respective optimal objective function values. 

C. INFINITE HORIZON INTEGER PROGRAMMING AND END 
EFFECTS 

Bean and Smith (1984, 1985, 1993), Ryan, Bean and Smith (1989), and Schochet- 
man and Smith (1989,1991,1992) investigate problem structures for which finite forecast 
horizons exist for obtaining optimal initial decisions for infinite horizon program structures 
that include infinite horizon integer programs (IP°°). Smith and Bean (1984) and Schochet- 
man and Smith (1992) assume in general the following: 

•All cost functions are continuously discounted. The necessary level of 
discounting is driven by the nature of the cost function and is required to 
ensure a finite cost over the infinite-horizon. 

•All problem characteristics are deterministic. The problem is well defined 
over the infinite-horizon. 

• At any time period the choices available are finite in number. This is a critical 
requirement to ensure existence of a finite forecast horizon. Schochetman and 
Smith (1992) relax this assumption so that feasible choices need only lie over 
a compact space. In this case, since the number of feasible choices can easily 
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be uncountably infinite, the definition of forecast horizon is modified to be a 
horizon for which a quantifiable small <6 tolerance exists (based on an 
imposed metric) between an infinite optimal and candidate optimal solutions. 
This assures the existence of some finite T period approximation such that the 
solution obtained is 5 optimal to the infinite-horizon problem. 

•All cumulative net cost functions are the difference of a monotone cost 
function and a monotone revenue function, both of which are uniformly 
bounded by some exponential. This requirement helps to ensure the existence 
of a feasible finite cost over the infinite-horizon. 

Bean and Smith (1984) define any sequence of decisions which cover the infinite- 

horizon as a strategy, and the individual decisions associated with any strategy as policies'^. 
A further assumption is made that the infeasibility of any strategy is a property that can be 
identified by observing at most finitely many initial policies. 

1. Problem statement 

The sequence 7t ={7ti, K 2 , 113 ,...} is a strategy where each element Kf is a policy. The 
number of available policy choices for Kf is finite and the feasible policy set is a function 
only of past policies (7t2,7t2v%-i)- L^t fl be the set of all feasible strategies. 

Let C^(t)= .K'n(t)-/?rt(t) where /^^^(t) and Kff(t) are assumed to be non-decreasing func¬ 
tions on and: 

0^jj(t)<Mc^ for all t>T, some y^; 

0^;j(t)<Me^ for all t>T, some y^. 

Define the net cost as: 


Cff (r) = je (t) (Note: r>y as a rule to ensure convergence). 
0 


Strategy is the term used by Bean and Smith to define a sequence of decisions feasible over the 
infinite-horizon. Svoronos (1985) uses the term trajectory. Both terms are in essence identical. 
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The problem of interest then is: 

Minimize (r) 

Subject to:ne IT. 

This problem definition includes any class of problems such that the solution space 
at any particular decision point is cost bounded, including mathematical program formula¬ 
tions for which k represents any feasible sequence of decision variables (xq, xj, X2, x^,...) 

OO 

over some defined region X, and C,, (r) is defined as X , where c, and x^ are vec- 

1 = 0 

tors in R^. The main over-riding assumption is that the feasible Xj lies in a non-empty com¬ 
pact region (based on the defined metric) for all t. 


2. Topology of feasible space 

Smith and Bean (1984) impose a metric topology over the feasible strategy space, 
and using the associated inherited properties of metrics show the existence of finite forecast 
horizons. This section provides a brief summation of the defined metric, and some of the 
key results derived by Smith and Bean. 

Let K and 7C' be two strategies in 11. Define the distance between Ttf and 7i'/ (where 


these represent the policies in strategy % and %' respectively) as: 


4> (TCf, n\) 


^ 1 if t^policies different 
kO if t^policies same 


This metric holds when the number of decision choices for is finite. If the number 

of choices is not finite, but forms a non-empty compact subset of and the feasible 
space is compact, the standard Euclidean norm is used (Schochetman and Smith (1992)). 
Further, define: 


p(7t,7U') = X (0• 
t = l 
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Smith and Bean (1984) and Schochetman and Smith (1989, 1991,1992) prove the 
following key results: 

•(p,n) is a metric space and n is compact (i.e., complete and totally bounded) 
in the metric. 


•Given p(n,n' )<8<i/2", and the decision space is finite with the finite metric, 
then <|) (n„ n',) =0 for all t<n, which implies Jt,=7t/ for all 


•If Um, 



< r , then the cost function is bounded. 


T 

•Define C„ (r, T) = \e'"dC^ (t) , to represent the total cost of any feasible 

0 

strategies over the horizon [0,71. Also define any Min (r, T) as 

C*(7). Then C*{T) converges to the infinite optimal solution C* as T . 

•If the infinite-horizon optimal strategy 7r*is unique, then the optimal strategies 
associated with the I period problems k*(T) converge to n* as T -4 «>. 

•Given a finite set of possible solution policies at each decision epoch, and 
given any policy period t of interest, there exists some T for which 7t/7) 
(t<T<°o) is an optimal TZf policy for the infinite-horizon problem. If the 
solution space is not finite, then under the revised metric (using the Euclidean 
norm), there exists some Tfor which the Euclidean norm of ( 7 C,(T)-iij )<8 
(where ;<T<«>), where n^T) is the optimal policy obtained using a T period 
approximation and is an optimal policy for the infinite-horizon problem. 
Tt/T) is defined as a 5 optimal policy for the infinite-horizon problem. 

•Given the infinite-horizon optimal strategy 7C* is unique, there exists some T* 
for each t>0, for which Tit(7) (T>T*) is an optimal policy (or 6 optimal if 
the number of choices is infinite) for the infinite-horizon problem. 

•Given the first L policies of any optimal strategy n* are unique, there exists 
some T* for each t where 0<t^, such that tc^T) (all T>T*) is an optimal 
policy (or 5 optimal if the number of choices is infinite) for the infinite- 
horizon problem. 
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3. Stopping Rule Criteria 

Stopping rule criteria proposed by Bean and Smith (1984), ensure that a finite fore¬ 
cast horizon can be identified for initial decision policies. Schochetman and Smith (1989, 
1991, 1992) further develop stopping rule criteria for finite and compact feasible solution 
sets by essentially solving finite-horizon problems over a finite cover of potential ending 
conditions and examining the resulting efficient set (defined by Schochetman and Smith 
(1992)) of optimal solution sequences This approach is similar to the fixed end effects ap¬ 
proximation method presented in the linear programming section, except instead of guess¬ 
ing an optimal end condition, the approach examines all potential end conditions. 
Schochetman and Smith (1989,1992) also modify the stopping rule criteria to deal with the 
problems associated with isolating an infinite optimal when multiple infinite optimal so¬ 
lutions are possible. For a detailed discussion, see Schochetman and Smith (1989, 1992). 

4. Applicability to the end effects problem 

The general staircase structure represents a fairly robust subset of infinite-horizon 
mathematical programs, including infinite-horizon bounded integer formulations. The 
main difficulty lies in implementing the stopping rule criteria proposed by Smith and Bean 
(1984), and more recently the modified stopping rules of Schochetman and Smith (1989, 
1992) when the number of possible ending conditions is large or uncountable. For example, 
if the discrete mathematical program of interest is an infinite-horizon integer program, each 
T horizon problem itself may be NP hard (or complete). As a rule, exact solutions are re¬ 
quired. Solving a number of integer programs that is equal to the number of potential end 
conditions (re-solving for each end condition) at each time step T, and then dealing with the 
associated multiple optima, can quickly become computationally impractical. 

D. SUMMARY 

Of all the methods examined in this chapter to deal with end effects, the concept of 
extending the problem formulation over the infinite horizon, and then solving bounding ap- 
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proximations using primal and dual equilibrium approximations appears to be the most vi¬ 
able and practical approach in eliminating end effects associated with finite-horizon 
formulations. The extension and implementation of this methodology is the focus for the 
following chapters of this dissertation. 
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III. LPoo STRUCTURES THAT SATISFY DUAL EQUILIBRIUM 


When an infinite-horizon problem has an optimal solution structure that satisfies 
the assumptions of dual equilibrium for some finite T, the dual equilibrium approximation 
provides an optimal solution to the infinite-horizon problem and end effects, by definition, 
are eliminated. As discussed in Chapter I, few examples exist of infinite-horizon problem 
structures for which the form of the infinite-horizon optimal solution is known. In order to 
gain insight regarding the impact of end effects on LP°°, this chapter presents several simple 
problem structures and shows the dual equilibrium approximation generates optimal feasi¬ 
ble solutions to the original infinite-horizon problem. 

Sections A through D show several simple problem structures that have optimal pri¬ 
mal and dual decision variables which can be formed as a function of the optimal primal 
and dual decisions generated by a two period truncated model. Section E derives the limit¬ 
ing optimal primal and dual decision variables functional relationship as the solution hori¬ 
zon extends to +°°. The results of Romeijn, Smith, and Bean (1992) show the limiting 
values are optimal over the infinite horizon. These infinite-horizon optimal solutions satis¬ 
fy functional relationships assumed by dual equilibrium approximation, therefore, any op¬ 
timal solutions generated by using dual equilibrium approximation are also optimal for the 
infinite-horizon problem. 

A. K=pA SINGLE PERIOD OVERLAP STAIRCASE STRUCTURE 

The problem P(pA) has a single period overlap staircase structure with a constant 
right hand side following the first period which is shown below: 
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oo 


>s ( 0 ) 
>b (1) 
>b (2) 

H^k-2 

x^>0, (i=0,l,2...). 

The associated dual Z>(PA) is: 

oo 

Maximize UqS + ^ ufi 

i = l 

Subject to: 


UqA+ «^pa 


+v 

= C (0) 

UjA+ U2^A 


+ Vjl 

= ac (1) 

U 2 A+ M^PA 


+ V 2 I 

= ac (2) 

u^_jA+ 

MjfcpA 

+ ^k-l^ 

= a*"^c (k-1) 


u^>0, v.>0, (i=0,l,2...). 

For the above problems, p is a constant such that 0<^<1, and 0<a<l. To ensure 
strong and weak duality hold in the limit (Romeijn, Smith, and Bean (1992)), A>0, and c>0 
are also imposed. 

Property II: For any finite k period {k even) truncation of F(pA), defined as P{k^A), 
if Vq > ocP^V;, there exists an optimal set of decision variables {x,-} , {u^} , and 


Minimize ^ (xcx^ 

i = 0 

Subject to: 

Ax^ 

PAxp +Ax^ 

PAXy +Ax2 
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{ vf} (primal, dual, and dual slack variables respectively) of the form: 


k 

Xq = Xq, 

k 

Xj = Xj-, 

n=0 n=0 

{k-2) 

2 

“o = “o 2 

n = 0 

k-(i+ 1) 

ul = X .(-^)”(aP)” 

n = 0 

f (k-4)/2 \ f (k-4)/2 

vJ = Po^+(ap)^ X (ap)^” -V; ap^ X (“P^ ” 

V n = 0 ' ^ n = 0 

V* = a~^Vj (l<i^-l). 

Where Ug, u„ Xg, x„ Vg, Vj , are the associated optimal solutions to the two period trun¬ 
cated problems: 

P(2PA) (Two period Truncated Primal) 

Minimize cXq + acxj 

Subject to: 

Axq >s 

PAxq + AXj > b 

Xq,Xj>0-, 
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D(2PA) (Two period Truncated Dual) 
Maximize UqS + Ujb 


Subject to: 


UqA+Uj^A+VqI 


Uq,Uj,Vq,Vi>0. 


+ VjI = ac 


Proof: Along with primal and dual feasibility, the optimal solution sets for P(2|3A) 
and D(2pA) also satisfy complementary slackness. That is: 

Uq(Axq-s) = 0; 

Uji^Axg + Axj-b) = 0; 

^0^0 = 

^1^1 = 0- 

The proof shows the solution structure presented above satisfies (1) primal feasibility, (2) 
complementary slackness, and (3) dual feasibility (Karush-Kuhn-Tucker (KKT) require¬ 
ments for optimality). First let’s define the arbitrary k=even period primal and dual prob¬ 
lem structures of interest; 

P(kpA) 

k-l 

Minimize ^ oc cx^ 
i = 0 

Subject to: 

AXq 

PAjCp +AXj 

^Axj+Ax^ 


X. >0, {i=0,l,...k-l); 
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D(itpA) 


k-l 

Maximize UqS + ^ u-b 
i = l 

Subject to: 




UqA+ Uj^A 


+ V 

= c 

«yA+ U2^A 



= ac 

«2A+ MjPA 


+ V 

2 

= a c 



'^^k-2^ 

k-2 

= a 

IV 

Uk_iA 

v^>0, (i=0,l,...k-l). 


k-l 

= a ( 


(1) Show primal feasibility holds, i.e., show that the constraints of P(A:pA) are satisfied: 
xj^>0 (l<i^-iy, (1) 

( 2 ) 

^Axf.j'^+Ax/^^ (l<i^-l). (3) 

Given primal feasibility satisfied for P(2pA): 

Xq>0; 

xj>0- 

AXq>s; 
pAjtQ + >b. 

Equation (1) holds for i=0 and i=l, since xl = Xg and x] = x,. Equation f/j holds for 


2<i^-l since Xg,X]>0, Xi = 


i~J 


i~2 


i,l M) P M)T 


n -0 


n = 0 


(2<i^-l), and 


i-I 


X {-1) "P" ^0 (l<i^-l), (the latter can easily be shown by induction). 

n = 0 
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Equation {2) holds as x\ = Xq. Equation (3) holds when i=l since xl = Xo and x] - Xj. 

k /V 

When i is greater than one, substituting x, = Xj or 

X- = (2<i^-l) (hypothesis), 

as appropriate leads to the equality b < + Axj = PAa:, _; + Ax^, (l<i^-l), and 

x]>0. Therefore primal feasibility is satisfied. 

(2) Show that complementary slackness holds between the optimal primal and dual vari¬ 
ables for P(itpA) and D(k^A), i.e., show that: 

u^iAx^o-s) =0; (4) 

u.{^Ax\_^j+Ax\-b) = 0 (5) 

/.x] = 0 (0<i^-l). (6) 

Given complementary slackness between the optimal primal and dual variables for 
P(2pA) and D(2PA): 

UoiAxQ-s) = 0; 

uj (^^AxQ + Axj — b') — 0, 

^ 0^0 ~ 

VjXj = 0. 

Substituting = «/ X («P) and = x, (both from hypothesis). Equation (4) 

n^O 

is equivalent to multiplying Uq (Ax^, + s) by a scaler value. Therefore equation (4) holds. 
Substituting uf = u[a-'x x'' (-i)" (ap)") (i<i^-i) (hypothesis), and recogniz- 
ing that pAx^, + Ax^ = pAx._ ^ -i- Ax. (from primal feasibility results), equation (5) 
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(l<i^-l) is equivalent to multiplying Uj (+ Axj -b) = 0 by a scaler. Therefore 


equation (5) (l<i^-l) holds. 

To show equation ( 6 ) holds we need the requirement Vg > ap^V;. Examining , the fol¬ 
lowing equivalent relationship holds: 


v^o = = v^o (ocP) I (aP) -vA ar I (aP)'" .(7) 


Note that = 0 as complementary slackness holds for the two period problem. In 
addition 0 < a^^v,Xo < VgJCg = 0, since Vg, v^, Xo>0 , ap^>0 , and Vg> ap^V;.Therefore, 

k k 

VjXg = 0. Substituting these equalities into equation (7) leads to VgOCg = 0. 

Showing v]x] = 0 is trivial since x] = X; and v* = v,. Therefore v]x] = VjX, = 0. 
To show = 0 (2<i^-l),we need V/JCg = 0, which is shown above. Substituting 


Xi= (-/)"P"+^<,PI M)"P" ('2<i^-ij,andv* = a''^V;(2</^-7j,we 


obtain v*;c,. = a‘“'v;jC; X (-^) "P" + »^/^oP X (-^) "P" ( 2 <i^-l) ■ Recognizing 


VjX, = 0 and V;JCg = 0, this leads to v-xf = 0 (2<i^-l). Complementary slackness is 
satisfied for all k=even period truncated problems. 


(3) Show dual feasibility holds, i.e., show that the constraints of D(k^A) are satisfied: 
jA + afpA + vf_^ - a ~^c = 0 (l<i^-l); (8) 

ul_iA + vl_iI-a~^c = 0. (9) 
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Note that u^A +Uj^A-c = -v^I (Z)(2pA) first constraint). Substituting the equations 

c-VqI = UqA. + , and ac - Vjl = u^A (a rearrangement of the constraints for 

D(2PA)), we discover that the above equation reduces to: 

k-2 k-4 

n=0 n=0 

Since v*o must be greater than or equal to zero, we can derive a relationship that must hold 

for any k=even between and v,, i.e., 
k-2 k-4 

(aP)"“2V«P'2 (“P)'" - 

n = 0 n = 0 

Note that for all (k=even), if Vq > v^ap^ (hypothesis), the above equation holds. There¬ 
fore, equation (8), when i=l, is feasible for all k=even. Equation (8), (1 can be 

shown to hold by substituting «j_; = a/a' (-i)"(ap) j,and 
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k-a-n) 


M* = M; a‘'^x X (-i)"(ap)"] (hypothesis). Substituting the above into equation 


(8) provides the equivalent expression 


UjA a 


1 k i-1 

i + ^ ((ap)" - ( aP) ”) + v*_ jI-OL c which is equivalent to: 


a' ^u,A +v^i_,I-a'~'c. 


Noting that UjA + Vjl = ac (i</^-i)(D(2pA) second constraint) and letting 

(from hypothesis), substituting these relationships into equation (70), one 

obtains d~^ (UjA + Vjl-ac) . Equation (8) (l<i^-l) is equivalent to multiplying the 

second constraint of D(2pA) by a scaler. Therefore, equation (8) holds above for all 
k=even period problems. 

Equation (9) holds when (hypothesis), UjA + VjI = ac (7)(2pA) sec¬ 
ond constraint), and — V ja (hypothesis) is substituted into the equation. Equa¬ 


tion (9) is then equivalent to: 


ii^d ^A + -a^ 'c = a" ‘I a^A+ . 


k-l k-2 


k j 

^k-d 
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Which is equal to a* ^ {u^A + v -ac) = 0. Under the hypothesis. Equation (Pj is 

equivalent to multiplying the second constraint of D(2pA) by a scalar. Therefore, dual fea¬ 
sibility (equations (8) and (9)) is satisfied.The hypothesis variable sets satisfy KKT condi¬ 
tions for P(jtpA) and D(k^A) for any Uneven period formulation. 

QED {Property 11) 

The proof derives a functional relationship for the optimal primal/dual decision 
variables of the truncated problem over any even period solution horizon. This functional 
relationship depends only on the optimal decision variables for the two period truncated 
formulation, and the length of the solution horizon. The following sections examine several 
special cases and extensions of this problem structure. 

B. SPECIAL CASE: P(pA) WITH 

The problem P{^ADemand), p5^, has the following structure; 


oo 

Minimize ^ CLcx. 
i = 0 

Subject to: 

AXq ( 0 ) 

\)Axq +Axi (^) 

PAjCy +Ax2 (2) 

PAx^-2 ^b(k-l) 


x.>0 {i=0,l,2,...). 
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The associated dual D(^ADemand) is: 


00 

Maximize UqS + ^ u-b 


i = l 


Subject to: 


UqA+ Uj^A 

+V0I = C 

u^A+ « 2 p^ 

+VjI = ac 

U2A+ «jPA 

+V2/ = a c 

Ui^_jA+ M^pA 

r 

+Vj.,/=a 


u^>0, V. >0, (i=0,l,2,...). 

For the above problems, P is a constant such that 0<^<1, and 0<a<l. To ensure strong and 
weak duality hold in the limit (Romeijn, Smith, and Bean (1992)), A>0, and c>0 are also 
imposed. 

Property III: An optimal solution to P{^ADemand) exists where Xj = 0. 

Proof. Prove by contradiction. Assume there exists an optimal sequence 
{jCo, Xj, X 2 , X 5 , ...} to Pi^Demand) such that X]>0. Now examine the change in the 

objective function for the new sequence {Xg, 0,Xj+X2,X2, ...}. This sequence is still fea¬ 
sible since: 

Xi >0'^i; 

Axq > s (Constraint (0) of P(^ADemand)); 

PAxq + A{0) >b Since >^s>b (Constraint (7) of P(^ADemand)); 

PA (0) + A (Xj + X 2 ) > PAxy + Ax 2 > b (Constraint (2) of P(^ADemand)); and 

pA (x, + X 2 ) + Ax 2 > pAJc 2 + AJc^ > b (Constraint (3) of P(^ADemand)). 
However, note the change in objective function value. The objective function of P(pADe- 
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mand)) in period (1) decreases by the amount acxj since x,-^0. The objective function 
of Pi^ADemand)) in period (2) increases by the amount acx, since X 2 ^ . This 

leaves a net decrease in the objective function value for P{^ADemand)) of (a - a ) . 

Therefore, if any optimal sequence to P{^ADemand)) must have x, = 0. For the 
trivial case where c=0, the feasible solution with Xj = 0 is an alternative optimal. 

QED {Property III) 

Given there exists an optimal solution to P{^ADemand) with Xj = 0, the problems 
{PSubl) and {PSubl) shown below are equivalent to P{^ADemand) with x, = 0\ 


Minimize ^ acx^ 

i = 2 


rMinimize cXq 


Subject to: 
AXq>s 


(PSubl) + 


Subject to: 

AX2 

^AX2 +-^^5 


+Ax^ 


>b 

>b 

>b 


(PSubl). 


Xi > 0 , 0<^<1 

(i=2,3,...) 


Therefore, for a P(^ADemand) problem the optimal first period solution is found by solv¬ 
ing the one period truncated problem. Note that (PSubl) is just a special case of P(PA) 


where s=b. 


C. P(PA) WHERE 

The primal and dual formulations (defined as P(fiARHS) and D(^ARHSi) respec¬ 
tively) for the case when s=b are shown below: 
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Pi^ARHS) 


oo 

Minimize ^ acx.^ 

izzO 

Subject to: 

Axq 

^AXq +Axj ^ b 

^AXj +Ax2 

^Ax^_ 2 ^b 


x.>0 {i=0,l,2,...). 

Di^ARHS) 

oo 

Maximize ^ ufi 
i = 0 


Subject to: 


UqA+ «yPA 

+v 

WyA-t- U2^A 

+ VjI = ac 

U 2 A+ M^pA 

_ 2 

+ V 2 I = a c 

Ui^_jA+ My^pA 

1 

11 

1 

+ 


u.>0, Vj.>0, {i=0,l,2...). 

Property IV: For any finite k period {k even) truncation of P{^ARHS), there exists 
an optimal set of decision variables {x*} , {af} ,and {v*} (optimal primal and dual vari¬ 
ables respectively) of the form: 
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4 =*oX (Oiiik-1)-. 

n = 0 

k- (i+7) 

ul = u„ol X (-i)"(aP)“ 

« = 0 

V. = av^. 

Where Xq, Uq, Vq , are the associated optimal solutions to the one period truncated prob¬ 
lems: 

P{1^ARHS) (One period Truncated Primal) 

Minimize cXq 

Subject to: 

Axq >b 

Xq>0 -, and 

D(l^ARHS) (One period Truncated Dual) 

Maximize UQb 

Subject to: 

UqA + VqI = c 

Uo,Vq, >0. 

Proof: Along with primal and dual feasibility, the optimal solution sets for 
P(l^ARHS) and D(l^ARHS) also satisfy complementary slackness. That is: 

u^iAxo-b) = 0 ; 

VoXo = 0. 

The proof shows that the solution structure presented above satisfies (1) primal feasibility, 
(2) complementary slackness, and (3) dual feasibility (KKT requirements for optimality). 
First let’s define the arbitrary k=even period primal and dual problem structures of inter¬ 
est: 
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Pik^ARHS) 

k-l 

Minimize ^ a cx^ 
j = 0 

Subject to: 

Axq 

^Axq +AXj 

PAjCy +Ax2 

x^>0, (i=0,l,2,...,k-l). 

D(k^ARHS) 

k-I 

Minimize ^ u^b 
i = o 

Subject to: 


UqA+ Uj^A 


+VqI = c 

UjA+ U2^A 


+v^I = ac 

, 2 

U 2 A+ KjPA 


+V 2 I = a c 



, k-2 


+Vk-2^ = a c 
, k-I 


Uk_iA 

+Vi^_jI = CL C 

U. > 0, 

v.>0, {i=0,l,2...M). 



(1) Show primal feasibility holds, i.e., show that the constraints of P(k^)ARHS) are satis¬ 
fied: 


xt>0-. 

(11) 

Aj:/>4; 

(12) 


>b 

>b 

>b 
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(13) 


Non-negativity (equation (11)) is satisfied since at* = 2 (O^i^-1) and 

n = 0 
i 

£ (-7) "P" > 0 (i^) (easily shown to hold by induction). Given the primal feasibility 

n = 0 

constraint A> & is satisfied for P(7pAi?H5), substituting Xq = Xg (hypothesis) into 
equation (12), primal feasibility is satisfied for all k= even period problems. When 0<i^- 

i 

7, substituting ^ (-7)"P" (hypothesis), as appropriate into equation (75) leads 

n = 0 

to the equality pAjc*./ + Ax^ = A (P^r*./ + a:, ) = Axq > b, (l<i^-l). Therefore primal 
feasibility is satisfied. 

(2) Show that complementary slackness holds between the optimal primal and dual vari¬ 
ables for P(k^ARHS) and D(k^ARHS), i.e., show that: 

H* (AxQ-b) = 0; (14) 

u\ ( PAa:*, ^+Ax\-b) = 0 (M^-1); (15) 

v]x^ = 0 (0<i^-l). (16) 

Given complementary slackness between the optimal primal and dual variables for 
PU^ARHS) and D{1^ARHS): 

UQ(AxQ-b) = 0; 

VqXo = 0 . 

Substituting ul = (-i)"(ap)") andx^ = 4 (both from hypothesis). Equation 

n = 0 

(14) is equivalent to multiplying Ug (Ax^ -b) = 0 by a scaler value. Therefore equation 
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holds. Substituting «* = a Mol X (--/)"(oc(3)"J (hypothesis) and 

PA:f_y+xf = Xq (resultofverifyingprimalfeasibility), equation (75) (7is equiva¬ 
lent to multiplying Uq (AXq -b) = 0 by a scaler. Therefore equation (75) (l<i^-l) 

i 

holds. Noting that X and v* = dvo(0<i^-l), 

n = 0 

v'lx'l = Vo^o«' X = Oxa!^ (-7)"P" = 0(0<i^-7). Equation (75) is satis- 

n-0 n=0 

fied. Complementary slackness satisfied for all k=even period truncated problems. 

(3) Show dual feasibility holds, i.e., show that the constraints of D{k^ARHS) are satisfied; 
u’^ jA+u^^A+v'^ jI-d = 0 (l<i^-l); (17) 

ul_jA + vl_jI = 0 . (18) 

Given dual feasibility UqA + VqI -c = 5 is satisfied for D(7PA7?775). 

Lets examine equation (17) (l<i<k-l) in the following form: 

m*_^A +M*pA +v._^/-a* = ( (u. y -I- M. P) A + Vj._y/-a c). (19) 

Substituting uf.; = d ^ul (-7)"(aP)"l and m,- = cluI ^ (-7) (ocp) 

into M*.y -I- M*p leads to the equality m*./ + M*p = d''uo. Substituting this into the right 
hand side of equation (19) one obtains d'^UgA + - d'^c. Now note that 

v'l_j = d~'vo (hypothesis). Using these two equations, we discover that equation (77) 

under the hypothesis reduces to oc" (UqA + VqI — c) = 0. Equation (77), 7<i<k-7, is 
feasible for all k=even. Equation (18) holds when Uf^_j = ot uo (hypothesis), and 
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v\_, = a''Vo (hypothesis), are substituted into the equation. Equation (18) is then equiv¬ 
alent to: 


a* ^UqA+o!^ = a (UqA +VqI- c) - 0. 

Under the hypothesis, Equation (iSj is equivalent to multiplying the constraint of 
D{1^ARHS) by a scalar. Therefore, dual feasibility (equations (17) and (18)) is satis- 
fied.The hypothesis variable sets satisfy KKT conditions for P(k^ARHS) and D(k^ARHS) 
for any k=even period formulation. 

QED (Property IV) 

Note that when s=b and P=i, problems P(^ADetnand) and P(^ARHS) are identical. 
In this case the results of both sections B and C apply. 


D. AN LPoo WITH EXPONENTIAL GROWTH 

This section describes a modification to the K=^A problem (herewith defined as 
PA/) by introducing a limited exponential growth (y>1.0 and (xy<l) of the right hand side 
starting with period;+7 where 2<j+l^-l. The problem P(pA;) has the following structure: 

oo 

Minimize ^ acx^ 
i = 0 

Subject to: 


Axq 




>s 

(0) 

pAjr^, 

+AXj 



>b 

(1) 


^Axj +Ax2 



>b 

(2) 



^Axj_j +Axj 


>b 

U) 



^Axj 

+AXj ^ j 

IV 

U+1) 




^Ax.^i +AXj^2 

IV 

bsj 

(7+2) 


jc. >0, (i=0,l,2,...). 
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The associated dual is D(^Aj): 


J • 

Maximize UqS + ^ u^b + '^ J ^uJb 
i = i i = j + l 

Subject to: 


UqA+ Uj^A 


+ V 

= c (0) 

UjA+ U2^A 



= ac {!) 

U2A+ MjPA 


+ V2I 

= ac (2) 


«^pA 


= (k-1) 


Uf>0, v.>0, (i=0,l,2,...). 

The growth factor y is limited to l<y<l/a to ensure convergence of the objective 
function, and 0<p<l. To establish strong and weak duality hold (Romeijn, Smith, and Bean 
(1992)), A>0, c>0, are also imposed. 

Property V: For any finite k period {k even) truncation of P(PA 7 ), defined as 
P{k^Aj), if Vo > ap^V;, and j^-1, there exists an optimal set of decision variables {xf} , 

{«*} , and {v*} (primal, dual, and dual slack variables respectively) of the form: 






L n = 0 


n = 0 


(2<i<j); 


= (P^o + ^;)Y S ^ p” 

v„ = 0 


+ ((-i)'^p'^)xj (l<r^-(J+l)); 
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(k-2) 

2 

Uo = Uq Y, 
n = 0 

k- (i + l) 

«f = ujo!-' X 

n^O 


f (k-4) > 


{ {k-4) \ 

2 


2 

;+(a|3)" X 

-^7 


V “ = ^ 


^ » = 0 j 


V* = a (l<i^-l). 

WhereK^,, iij, Xq,Xj, Vq, Vj , are the associated optimal solutions to the two period trun¬ 
cated problems: 

P(2^Aj) (Two period Truncated Primal) 

Minimize cXq + acxj 

Subject to: 

AXq 

+ AXj > b 
Xq, Xj > 0; and 

D(2^Aj) (Two period Truncated Dual) 

Maximize UqS + Ujb 
Subject to: 

UqA + Uj^A + VqI = c 

UjA +VjI = ac 

Uq,Uj, Vq,Vj>0. 


Proof: Along with primal and dual feasibility, the optimal solution sets for P(2^Aj) 
and D{2^Aj) also satisfy complementary slackness. That is: 
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Uq(Axq-s) = 0-, 

Uj(^AxQ + Axj-b) = 0; 

VqXq = 0-, 

VjXj = 0. 

The proof shows that the solution structure presented above satisfies (1) primal feasibility, 
(2) complementary slackness, and (3) dual feasibility (KKT requirements for optimality). 
First let’s define the arbitrary k=even period primal and dual problem structures of inter¬ 
est; 

P(k^Aj) 

k-l 

Minimize ^ ct"cjc„ 

n = 0 

Subject to: 


AXq 



>S 

(0) 

^AXq -^Axj 



>b 

U) 

^AXj ’\-Ax2 



>b 

(2) 


■\-Axj 


>b 

O') 


^Axj 

+AXj^j 

>yb 

(J+i) 




>yb 

0+2) 



_ 2 _ 1 


{k-D 


Xj>0 0<i<k-l). 
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Dimj) 


j k-l 

Maximize UqS + ^ + X 

n = 1 n=j + 1 

Subject to: 


UqA+ Uj^A 


+ V 0 I 

= c 

UjA+ U2^A 



= ac 

U 2 A+ MjPA 


+ V 

2 

= a c 




1 

il 


^k-I^ 


II 

1 


> 0 (0 <n<k-l). 




(1) Show primal feasibility holds, i.e., show that the constraints of P(A:pA) are satisfied. 


x/^>0 

(i<i^-iy, 

(20) 

AXq'^\ 


(21) 

PAXj.y^+Ax,-^^ 

(l<i^-l). 

(22) 


Given primal feasibility satisfied for P(2^Aj)‘. 

Xo>0\ 

Xj>0-, 

Axq>s; 

+ >b. 

Equations (20), (21), and (22) hold for 0<i<j since the primal variables have the same 
form as the problem P(il:PA). In order to prove non-negativity and that equation (22) holds 
for i>j, we first need the following lemma. 

Lemma: Given the above definition for an optimal primal variable set, then: 

^xl,+x1 = (Px,-hX;) (l<i<j) ; (23) 


66 



= y"(pXo + x,) (l<r<(k-l)-i). (24) 

Proof. Lets examine equation (23) first. Substituting 


r 

k ^ 

jj,- = 

- «= 0 


(-1) "P" + XoP X (■“^) ”P" the fact that x] = x,, we note 


thatpx5 + x* = ^Xj + x] = pX;+JC;(7-P) +Xo^ = +i;. Similarly, for (5 


i-1 i-2 

X—1 / o 


substituting x] = Xj^ (-^)"P" + ^oPZ (“■^)”P" (2^i^j) and 


pxf./ = P U/Z M)"P"+^oPX (-^)"P" , which is equal to 


^4 S (--^)"P" +j^oP[ (-1) X (-7)"P"J, we also obtain that 


P;c;_; + ;c‘ = (pJ^<, + ^/) (3<i$j)- 

To prove equation (24), we need 


= (Pxo + X;)y( I (-7)"y'"'''"P" + ((-^)'P')^; (l<r^-(j+l)) and 


= (P^o + ^;)y[X M)"Y‘^‘'''"P""'j+(M)^''P^)^J (2^^-(j+l)),both 

n~0 

of which are derived directly from the hypothesis. Adding these two equations together 
gives us 

= (p*,-^i,)Tx rfi (-;)"7‘"'’-"P"l+( '£ (-i)-Y‘"”-p"'J • 


Noting that X (-7)"P"^^ = i-1) X (-7) "y^"'^’""P", and substituting this 


into the above equation, we obtain 

P^!+r-;+^5+r = (P-^o + ^;)Y(y'"') = (P^0 + -^/)Y' 


QED (Lemma) 
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Given ;r;., = (P*„+*,)r(l ""P’) + ( M)'PV; (I<lA-(}+I)).Wt 

/I = 0 

first prove that > 0 (l<r<(k-l)-j) by induction. 

(a) x]^,>0. From our lemma, ^x]+x]^i = (pXo + X;) Y • This implies that 

jCy+; = (pJC(, + JC;)Y-Pxy. Now note from equation (23) that = (Px^ + X;) , 

which implies that x* = (P^q + .X;) - Pa:*./ or that Px* = P (P.^^ + X;) - ^ Xj-i. Sub¬ 
stituting this back one obtains 

x]^,= (pj^o + ^/)y-P^! = (pJro + ^/)Y-(P(P^o + ^/)-P'^5-/)-Note that the 
right hand side of this expression is equivalent to 

(Y-P) (pXo + JC;) +^^x].,>0(as (Y>P)flnc? (P^a;;./> 0) )• Therefore, >0. 


(b) Given that x]^, > 0 (l<r^<k-(j+l )), show that + y >0. Note that from our 
lemma Pa:5,„ + jc*„„,; = i^Xo + x,)y'""' md^x%„.,+x%^ = (pXo + X;)Y'” which 
implies that pxj^^ = p (pJc^ + X;) y"' - Therefore 

x"^„.^i = (pjeo + ^/)Y'"^'-(P(P^o + ^/)Y'”-P'^5+-«-/) or 

x%^,, = (Y-P) ((pJCo + ^;)Y'”) +^'x),„,.,>0(as {y>^)and (p'x*+„_, > 0)). 
Therefore non-negativity (equation (20)) is satisfied. To prove equation (22) holds, we 
again use the result of our lemma. From equation (22), we need to show that 

PAx‘.._,However, since Pjc*.,_,= {P^, + x,)/, then 

PAAr*„.,+Ax*„ = A((Pf,+x,)Y') = (PAf„ + Ax,)Y'aY'ft- 

Primal feasibility has been shown. 

(2) Show that complementary slackness holds between the optimal primal and dual vari¬ 
ables for P{k^Aj) and D(k^Af), i.e., show that: 

tt* (Axq -s) = 0; (25) 
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u] (pAx*_ ^+Axl-b) = 0 (l<i^-l ); (26) 


vfjcf = 0 (0<i^-l). 


(Note: This complementary slackness proof is very similar to the proof for problem 
P(PA).) 

Given complementary slackness between the optimal primal and dual variables for 
P(2^Aj) and D(2^Aj): 

Uq(Axq-s) = 0-, 

Uji^Axg + Axj-b) = 0 ; 

Vo = 

VjXj = 0. 

{k-2)/2 ^ 

Substituting Uq = Uq ^ (ap) and Xq = Xq (both from hypothesis), Equation 


(25) is equivalent to multiplying Uq (AJc^ - 5 ) by a scaler value. Therefore equation (25) 


k-a+i) 


holds. Substituting m* = m J a" x X (-^) («P) J (l^i^-1) (hypothesis), and 

recognizing that PAJc^ + Ax j = (PAj(r*_ j + Ax ^) , (for i<j), and that 

^Ax]^,_,-\-Ax]^, = y'(PAJCo + AJC;) , (/or 7<r<(A:-i>;) (from primal feasibility results), 
equation (26) (l<i^-l) is equivalent to multiplying u j (pAx^, + Axj-b) = 0 by a 
scaler. Therefore equation (26) (l<i^-l) holds. Equation (27) is shown to hold by exam¬ 
ining the equation in terms of Vq, Vj,Xq,Xi, and using the requirement that Vg > aP Vj. 
Examining VoX*, the following equivalent relationship holds: 


vUo = vjjc, = i+ (aP)^ I (aP)^" -v^ aP I (aP) -Notethat 
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VoJCg = 0 as complementary slackness holds for the two period problem. In addition 
0 < <VoXo = 0, since v^, Vj, Xo>0 , ap2> 0, and Vo > ap^V;. Therefore 

VjXg = 0. Substituting both these equivalent relations into the above equation it is clear 

that VoJcJ = 0. Showing v]x] = 0 is trivial since Xj = x, and v] = v^. Therefore 
v]x) = VjX, = O.Toshowvfxf = 0 , we need = 0. Substituting 

4 = kS M)"P" + ^oPX {-l)T'\(2<i<j) ,or 

^ n-0 n^O 

= (P*. + *,)y( I (-Y)'y‘"'”"P")+ ((-')T)^; 

^ n-0 

V* = a '^V; f2<i^-i),weobtain 


v‘x,‘ = a'-'M;Z (-;)"r+ «'■'!>API M)"PV2a<j).or 


(7<r^-0+i;j. Recog- 

n = 0 

nizing V;JC; = 0 and V;JCo = 0, and that both of the above equations are of the form 

(fVjXg + XvjX, ftp aiid X scalars), this leads to vfx* = 0 (2<i^-l). Complementary 
slackness is satisfied for all k=even period truncated problems. 


k j + r-}^ 

Vj^rXj^r = « 


(3) Show dual feasibility holds, i.e., show that the constraints of D{kf!)Aj) are satisfied: 
u._lA + ttfpA + vf_ j-a~^c = 0 (l<i^-l ); (28) 

ul,A^vl,I-a’^-^c = 0. (29) 
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Given dual feasibility is satisfied for D{2^Ai): 

UqA+Ui^A + VqI- c = 0; 

UjA +V jI-QLC = 0. 

(Note; This is identical to the proof for problem P(pA).) 

{k-2)/2 

Examining equation (2Sj when i=7, substituting = Uq ^ (otp) (hypothesis) 

H = 0 


(fc-2) 


andMy = M; (-7)”(a|3) (hypothesis), we get the following reformulation: 


ttoA+M;pA-c+(MoA + M/pA)! X (aP)'” X +v\l = 0 


Note that UqA + w^pA -c = -VqI {D{2^A]) first constraint). Substituting the equations 
c-VqI = UqA + Uj^A ,andac-v^/ = UjA (a rearrangement of the constraints for 
D(2PA7)), we discover that the above equation reduces to: 

k-2 k-4 

2 2 

n=0 n=0 

Since v^q ^^^t be greater than or equal to zero, we can derive a relationship that must hold 
for any k=even between and v 

k-2 k-4 

n = 0 n = 0 

Note that for all (k=even), if > v^ap^ (hypothesis), the above equation holds. There¬ 
fore, equation (28), when i=l, is feasible for all k=even. Equation (28), (l<i^-l), can be 

shown to hold by substituting = «;la' X (-'^)"(otP)"j> 
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/ A:-(i+7) \ 

wf = u\ a'"^ X Y, (“■^)" ” ] (hypothesis). Substituting the above into equation 


(28) provides the equivalent expression 


UjA a 


- ^ k-i 

Qi)~^ j+ ^ ((aP)” - (aP)”) + a'which is equivalent to: 

^ n = 1 ^-1 


i-2 ^ A ^ r 

a KyA + v,_;/-a c 


(30) 


k i-2^ 

Noting that UjA + Vjl = ac (D(2^Aj) second constraint) and letting v._j = a v; 
(l<i<k-l) (from hypothesis), substituting these relationships into equation (30), one 
obtains a (UjA + Vjl - ac) . Equation (28) (l<i^-l) is equivalent to multiplying the 

second constraint of D(2^Aj) by a scaler. Therefore, equation (28) holds above for all 
k=even period problems. 

Equation (29) holds when ; = a~^ui (hypothesis), A + v^/ = ac (D(2^Aj) 
second constraint), and v,^_j = (hypothesis) is substituted into the equation. 


Equation (29) is then equivalent to: 


^ k-2 . k _ k-1 

Uja A + Vj^_jI-a c 


k-2 

a 


UjA + 



k-2 

a 



Which is equal to a* ^ (UjA + v^Z-ac) = 0. Under the hypothesis. Equation (29) is 

equivalent to multiplying the second constraint of Z)(2pA) by a scalar. Therefore, dual fea¬ 
sibility (equations (28) and (29)) is satisfied.The hypothesis variable sets satisfy KKT con¬ 
ditions for P(kfiAj) and D(kpAj) for any k=even period formulation. 

QED {Property V) 


72 



E. P(|3A) AND K=pA7 RELATED TO PRIMAL/DUAL EQUILIBRIUM 

The problem structures examined all have the property of satisfying strong and 
weak duality in the limit (Romeijn, Bean, and Smith 1992), and that any convergent subse¬ 
quence of the optimal decision variables (primal and dual) converge to an infinite optimal 
solution. This allows the examination of the dual multipliers for the K=^A and K=^Aj stair¬ 
case truncated linear programs (the number of periods k even) as the number of periods k 

goes to infinity. As shown below, the dual multipliers converge iou. = a \j, i.e ., dual 


equilibrium is satisfied from period one onward for the infinite-horizon linear program 
(Grinold, (1983b)). Additionally, we verify that for when P<1, primal equilibrium is 
satisfied in the limit. 

Model K=^A, p=l: 


Uq = Uq 


f{k-2)/2 \ 

2n 

E “ 

n=0 ^ 


k ^ 
U, = U 


f fc-(i + y) 

(/-/) 
a 




V 


X . 

(-7) a 

n = 0 ^ 




As k —> 00 : 


Uq-^Uq 


1 


U 1 —> M .1 -z - 

^ ^Vi + a 


1 -a 
1 




= Uj\ 


and 


It is clear by substitution that «,• = a' 'ui. Therefore, dual equilibrium conditions 


are satisfied (Grinold (1983b)). 
Model ii:=pA,)3<7: 




{k-2) 

2 

ul) = Uq S 
« = 0 

k-(i + 1) 

n = 0 

A = I M)”P"+*(,P I (-■')"P" (2sa-fl- 

« = 0 n = 0 

As k -4 co; 

, k ^ i-lf 1 ^ ~ 

As k, -4 00 : 

(for any r=l,2,...,k) 

It is clear by substitution that u. = a~^Uj, and that x- converges in the limit to 

X for all i. Therefore, dual equilibrium conditions are satisfied and primal equilibrium con¬ 
ditions are satisfied in the limit (Grinold (1983b)). 
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Model K=^Aj, with 0<a<i, P<i, 7>1 and a'^<l: 


k 

Xq = 


Xj = Xj\ 

r i-1 
k 

Xi = 


i-2 


hi W)T 

L n = 0 n = 0 

fr-l 


= (P^(, + x^)Y 


(2<i<j)-, 


X ”p” + (l<r^-(j+l))-, 

V„ = o y 


{k-2) 

2 


“o = “o S 

n = 0 

k -(/ + /) 

u. = M;a~^ Y. (-^)"(«P)" 

n=0 


^0 = ^0 


ik-4) 

2 

2 2n 


i+(ap) Y 

n = 0 




{k-4) 

2 

(ap^) Y («P)^” 

n = 0 


V* = a ^Vj (l<i^-l). 


As k —^ 


Uq^Uq 


i-(aP) 


2 l = “0’ 


k ^ i 1 
u, —> a, 




k ^ i-H 1 


It is clear by substitution that u. = a ^Uj . Dual equilibrium conditions are satis¬ 
fied (Grinold (1983b)). 
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F. SUMMARY 


The following summarizes the key results of this chapter; 

•The structure with |3=7, satisfies dual equilibrium from period one 
onward, as M. = a~^Uj (i>i). However, primal equilibrium (using restric¬ 
tions X(=X(+]) is never satisfied as the optimal primal sequence is cyclic, with 
periodicity two. Primal restrictions of the form Xt=x^+2 allows primal equilib¬ 
rium to collapse to an infinite-horizon optimal. 

•The A’=PA staircase structure with P<7 and the K=^Aj structure satisfies dual 
equilibrium from period one onward, as u. = a ^Uj (i>l). 

It is also important to note that for these particular problem structures, solving the 
two period truncated solution provides all the information needed to derive an optimal so¬ 
lution sequence {x, } to the infinite-horizon formulation. 

If a problem of interest satisfies any of the problem structures defined in this chap¬ 
ter, or is an example of other specific problem structures for which the form of the infinite- 
horizon solution can be found (c.g., Grinold and Hopkins (1973a)), then the infinite-hori¬ 
zon optimal solution can be solved for directly. However, in general, for most practical 
problems, it is difficult to ascertain enough information regarding the form of the infinite 
optimal solution, to use direct methods. Therefore, a bounding approximation is needed for 
most real-world applications. The next chapter explores the properties associated with pri¬ 
mal and dual equilibrium approximations, and confirms that these methods generate valid 
bounds over a large class of potential problem structures. 
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IV. CONVERGENCE PROPERTIES OF PRIMAL, DUAL 
EQUILIBRIUM, AND TRUNCATION APPROXIMATION 

METHODS 

Svoronos (1985) first introduced the notion of using primal and dual equilibrium 
approximations to establish an approximate value for the optimal objeetive value for a gen¬ 
eral class to infinite-horizon convex programs. This chapter shows that when appropriately 
defined, primal and dual equilibrium approximations generate upper and lower bounds re¬ 
spectively for both LP°°, and for infinite-horizon integer and mixed integer programs 
(M/Poo). Sections A introduces notation for this chapter. Sections B and C prove the primal 
and dual equilibrium optimal objective function values, when properly established, always 
bound the infinite-horizon optimal objective function value. Section C also establishes that 
convergence of the truncated optimal objective function value to the infinite optimal solu¬ 
tion implies the optimal objective function value for the dual equilibrium approximation 
converges to the infinite optimal solution. Section D provides an illustrative example, 
where both truncated and dual equilibrium approximations converge to the infinite optimal, 
however, a duality overlap exists. Section E discusses how these results may be used in 
practice. 

A. NOTATION 

This section uses the following mathematical notation where, unless stated other¬ 
wise, holds for both LPoo and MIPoo: 

oo 

OO ^ 

jr° The feasible region for the infinite-horizon formulation, X 

t = 0 


11 



The feasible region for a T period truncated approximation of the infinite- 

oo 

oo /I 

horizon formulation, Xj c n 

t = o 

Xpj^ The feasible region for a T period primal equilibrium approximation of the 

oo 

infinite-horizon formulation, with cuts of the form ^Pj £ f][ ^ ’ 

t = o 

Xdj" The feasible region for a T period dual equilibrium approximation of the in¬ 
finite-horizon formulation, where all constraints containing the decision variables {t>T) 

oo 

oo ^ 

are aggregated using an a discount factor, XdjC ns"™; 

t = o 

V°° The optimal objective function value for the infinite-horizon formulation; 

Vx" The optimal objective function value for the T period truncated approxima¬ 

tion; 

Vpx" The optimal objective function value for the T period primal equilibrium ap¬ 
proximation; 

Vd/" The optimal objective function value for the T period dual equilibrium ap¬ 
proximation; 

Vp" The value of the lirriT^^Vp t when it exists; 

Vd" The value of the linij ^^Vd°°T when it exists; 

X An infinite sequence of decision variables {xj} that is feasible to the infinite- 

horizon formulation (i.e., xe Z“); 

Xf An infinite sequence of decision variables {Xj} that is feasible to the trun¬ 
cated formulation (i.e., Xj-e Xj- ); 
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xpj An infinite sequence of decision variables {xj that is feasible to the primal 

equilibrium approximation {i.e.,xpj& Xpj°°)', 

xdj An infinite sequence of decision variables {aTj} that is feasible to the dual 

equilibrium approximation {Le., xdj& Xd-f). 

B. PROPERTIES OF PRIMAL EQUILIBRIUM APPROXIMATIONS 

The relationship between a primal equilibrium approximation and its infinite-hori¬ 
zon formulation: 

Given any infinite-horizon formulation (restricted in this case to LP°° or MIP°°), 

primal equilibrium approximations are additional restrictions placed on X°°, start¬ 
ing at some finite period T, that result in a finite period equivalent formulation of the 
problem, with a non-empty feasible region. 

This is a slightly more general definition than that of Manne (1970) presented in 
Chapter 11. The defining restrictions limit choices to those that maintain primal feasibility 
and allow for the constraints in the original formulation to eventually become redundant, 
by creating a functional tie between a finite set of decision variables and the rest of the vari¬ 
ables in the sequence. This allows primal equilibrium approximations to be solved as 
equivalent finite period formulations. For the lower triangular structured LP«> presented 
in Section A.l.g of Chapter II, restrictions of the formx:t=Aa:t+i are viable. However, when 
X=l, restrictions of the form Xf=X(+i^ (k finite) are viable for both LP°°, and when the for¬ 
mulation is restricted to integer, i.e., MIP°°. 

Given this defining relationship between the original infinite-horizon formulation 
and the primal equilibrium approximation, it is possible to establish several general rela¬ 
tionships relating the optimal value of the primal equilibrium approximation to the optimal 
value of the infinite-horizon optimal solution. 
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For the remainder of this section the following assumptions hold: 

•The infinite-horizon problem of interest is to minimize a linear objective 
function, over a defined and non-empty feasible region. 

•Restrictions can be identified that generate non-empty feasible regions and 
finite period re-formulations with finite optimal objective function values. 

•A finite optimal exists for the infinite-horizon problem. 

1. Monotonic Behavior of the Primal Equilibrium Approximation 
Objective Value 

Property VI: The optimal objective function value for the primal equilibrium ap¬ 
proximation is monotonic and non-increasing with increasing T. 

It is clear that Xp^ c Xp^^,, since Xp°j=Xp°j^in {Vr = Xr+z.} (i-e., X e Xp^ 

implies x e Xp°j.^,). Let xpr be any optimal solution with objective function value Vpj 

to Xpt . The objective function value Vpj provides an upper bound on the optimal objec- 

five function value Vpr+z determined over the feasible region Xp°^^ ,, since xpr e Xpj+,. 

Therefore, the optimal objective value Vpj is monotonically non-increasing with increas- 

OO OO 

mgT;i.e.,Vpj, >Vpj^j . 

QED (Property VI) 

2. Relationship Between the Primal Equilibrium Approximation 
and the Infinite-Horizon Optimal Objective Function Value 

Property VII: The optimal objective function value for the primal equilibrium ap¬ 
proximation generates an upper bound for the optimal objective function value for the in¬ 
finite-horizon problem. 

For any T, given xpj^ Xp°j-, then xpj & X as by definition 
Xpj=X°°n {x, = Vt>T} . Therefore, since xpr e A"", it’s associated objective 
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function value Vp^ > V”. Assume further that there exists a T such that Vp-r is finite. In 

this case, the limit of Vp^ , defined as Vp’^ exists, and Vpj>Vp°l^ ,> Vp°°> V . 

QED (Property VIP) 

3. Convergence Properties of Primal Equilibrium Approximation 

There are relatively few assumptions required to show both and Vp°° exist 

and bound V°° from above. However, the conditions under which Vp°°=V°° are problem 
specific and more difficult to in general to verify. Manne (1970), and Svoronos (1985) de¬ 
velop problem structures that ensure when primal equilibrium restrictions are used, the ob¬ 
jective function value and a subsequence of decision variables converge to an infinite- 
horizon optimal. Verifying convergence is highly dependent on both problem structure, and 
on the choice of restriction. This is illustrated with the following example: 

Minimize X2 
Subject to: 

Xj +X 2 = 1 

X2 +-*^5 = 7 

Xi >0 

Given any T, the primal restriction A!:t=JCt+i for all t>T, leads to an optimal solution 

of Vp°°=VPt’^=0.5, and the optimal solution sequence {0.5,0.5,0.5,...}. It is clear by in¬ 
spection however, that the minimum possible solution is X2=0, and that the sequence 
{1,0,1,0,1,0...} is a feasible sequence with X 2 and the optimal objective function equal to 
0.0. If the primal restriction is used for any T>1, the resulting feasible region 

still includes the optimal sequence {1,0,1,0,1,0...}., resulting in Vp =VPt =V =0.0. 
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Verifying convergence of primal equilibrium approximations to the infinite-hori¬ 
zon optimal, using any restriction is non-trivial. However, given the restriction generates a 

non-empty feasible region, the solution V/?/ is an upper bound for y“ , and its associated 
decisions xpr^ X°°. This allows for practical implementation of primal equilibrium as a 
method to generate a sequence of non-increasing upper bounds for F” . 

C. PROPERTIES OF DUAL EQUILIBRIUM APPROXIMATIONS 

The relationship between the dual equilibrium approximation and the original infi¬ 
nite-horizon formulation: 

Given any infinite-horizon formulation (LP°° orMIP°°), where the constraint 
space is lower triangular in nature, the dual equilibrium approximation are relax¬ 
ations over X^. This relaxation takes the form of aggregating all constraints that in¬ 
clude Xp for all t>T, (T some fixed integer value) using a discount factor a, to form 

one constraint. The aggregation allows the variable Xp= X and for the infinite 

t = T 

constraint space to be collapsed such that an equivalent finite period formulation ex¬ 
ists. 


Chapter II provides a detailed discussion of dual equilibrium approximation as ap¬ 
plied to LPoo, however the point is that the dual feasible region derived, Xdf □ A” for all 

T. When is the feasible region of a MIP«> formulation, the relaxation can involve not 
only aggregating the constraint space, but also relaxing the integrality of the decision vari¬ 
ables. 

For the remainder of this section, the following assumptions hold: 

•The infinite-horizon problem of interest is to minimize a linear objective 
function over a defined non-empty region. 
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•A finite optimal solution exists for the infinite-horizon problem. 

•For some T, (I finite) a finite optimal solution exists over the dual feasible 
region Xdj°°. 

1. Monotonic Behavior of the Dual Equilibrium Approximation 
Objective Value 

Property VIII: The optimal objective function value for the dual equilibrium ap¬ 
proximation is monotonic and non-decreasing with increasing T. 

This is obtained directly be realizing that Xdf° 3 Xd°°T+i- Therefore, 

X e Xd°°T+i V e Xrf“r - Then any optimal solution xdr+i to the T+1 period dual equi¬ 
librium formulation, is a feasible point for the T period dual equilibrium relaxation. This 

implies that Vd°°T+i is an upper bound for Vd t • Therefore, the optimal objective function 

value is a non-decreasing sequence with increasing T, i.e., Vd°°T^Vd t+i for all T. 

QED {Property VIII) 

2. Relationship Between the Dual Equilibrium Approximation and 
the Infinite-Horizon Optimal Objective Function Value 

Property IX: The optimal objective function value for the dual equilibrium approx¬ 
imation generates a lower bound for the optimal objective function. 

This again comes directly from the definition of dual equilibrium. By definition, 

Xdf° 3 X°° for all T. This linked with our previous result leads to Xdf° 3 Xd°°T+i 3 Z 
for all T. Since any x e Z” => v e Xd°°T^i => v e Xd °°t , any optimal x to Z”” with objec¬ 
tive value V“, is and upper bound for the value of Vd t+i ^ which is an upper bound for the 
value of Vd~r. Given that V°° exists and is finite, and that for some T, a finite solution exists 

Vd“r, then the sequence formed by { Vd“r} is a monotonic, non-decreasing sequence of 
real numbers bounded above by a finite value, which implies that this sequence has a lim- 
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iting value defined as Vd^<V°° . Therefore, the dual equilibrium approximation provides a 
non-decreasing sequence of lower bounds with increasing T for the optimal objective func¬ 
tion value of the original primal infinite-horizon formulation. 

QED {Property IX) 

3. Convergence Properties of Dual Equilibrium Approximation 

As illustrated in the previous section, relatively few assumptions are required to in¬ 
sure that the dual equilibrium formulation, when properly derived, provides a valid lower 
bound for the optimal objective function value for the infinite-horizon formulation. How¬ 
ever, conditions under which Vd‘°=V°° are more restrictive and become problem specific 
in nature. Grinold (1977,1983b) and Svoronos (1985) have derived convex infinite-hori¬ 
zon structures for which dual equilibrium approximation values (variable and objective 
function) converge in the limit to an optimal associated with the infinite-horizon formula¬ 
tion. In general confirming convergence involves verifying that in the limit, a subsequence 
of the optimal decision variables derived using dual equilibrium approximations converge 

to some feasible sequence over X^. 

If the truncated formulation objective function value is convergent to the infinite 
optimal, then the dual equilibrium approximation is convergent to the infinite optimal as 

well. In this case, by construction 3 Xdj°° , (i.e., x e Xdj , implies x e Xj. ). Since 
xdj. is an element of A/, this implies that Vdj” is an upper bound for Vx°° 

{VT°°<Vd/’<V" for all T). Therefore, if V”, this implies Vd^ V°. 
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D. AN EXAMPLE WHERE DUAL AND TRUNCATED 

APPROXIMATIONS ARE CONVERGENT AND A DUALITY 
OVERLAP EXISTS 

Consider the following example originally introduced by Grinold and Hopkins 
(1973b) and modified by Romeijn, Smith, and Bean (1992) to include bounds on the vari¬ 
ables. 

Primal Formulation: 



maximize ay + Vy-^(2 * ^Pf + 2^ ^q. + r.) 

V i = i 

Subject to: 

Ui-2v._^j-Pf<0(i=l,2,...)‘, 

v.-2u._^_j-qi<0(i=l,2,...)-, 

(j=7,2,...). 

It is a simple matter to verify that the best possible optimal primal objective is 0, 
and that the following solution is optimal for the primal infinite-horizon formulation: 
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y^=T-\i=l,2,...)\ 

Zi=0, {i=l,2,...). 

Note that this solution is an optimal solution for any truncated or dual equilibrium 
approximation (with period T). Therefore, in this case both the truncated and dual equilib¬ 
rium approximations converge to the infinite-horizon optimal solution and provide a finite 
set of decision variables that are part of an optimal set to the infinite-horizon primal formu¬ 
lation. 

However, now examine the dual infinite-horizon formulation. It is easily shown that 
the following solution set is feasible and generates a optimal objective function value of 2 
for the dual infinite-horizon formulation: 

■’< = (!)'■' 

Pi=qi=ri=0(i=l,2,-)- 

In this case weak duality fails however both truncated and dual equilibrium approxima¬ 
tions provide convergent solutions to the infinite-horizon primal optimal. 

E. SUMMARY 

This chapter shows that when properly defined, primal and dual equilibrium ap¬ 
proximations bound the infinite-horizon optimal objective function value for both LP<» and 
MIP~. Further, any primal equilibrium optimal solution is feasible over the infinite-hori¬ 
zon. This ability to bound the objective function value of the primal infinite-horizon for¬ 
mulation, is key to quantifying the influence of any end effects acting on the primal and 
dual equilibrium approximations. Other authors have almost exclusively focused on the is¬ 
sue of convergence (Svoronos (1985) for Convex Spaces, Schochetman and Smith (1992) 
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for infinite dimensional spaces that include MIP«>). Convergence is a problem specific is¬ 
sue, and cannot be verified in general. If the difference between the primal and dual equi¬ 
librium approximation objective function values is small, then whether or not the solution 
is convergent to the infinite optimal is of little practical importance, as primal and dual 
equilibrium approximations generate a solution to the infinite-horizon problem which is 
measurably (examining objective function values) near optimal. Following chapters exam¬ 
ine the effectiveness of primal and dual equilibrium approximations to both generate tight 
bounds on the infinite optimal solution, and to eliminate end effects associated with trun¬ 
cated formulations. While the issues of weak and strong duality are also of theoretical in¬ 
terest, our focus is on solving or bounding the infinite optimal solution to the primal 
infinite-horizon formulation. Strong and/or weak duality may or may not hold: Primal and 
dual equilibrium approximations always bound the infinite-horizon optimal for the primal 
formulation. 

A major flaw from a modeling perspective in extending truncated formulations over 
an infinite-horizon, is the assumption that the problem structure over the infinite-horizon is 
completely known. While many problems subject to end effects have indeterminate hori¬ 
zon lengths, their structure is not necessarily known. If this extension method is to prove 
valid, tests must be devised to examine the variability of initial period optimal decisions to 
changes in future period coefficients, that were not originally modeled in the truncated for¬ 
mulation. The next chapter focuses on this issue for LP«>. 
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V. DETERMINING THE STABILITY OF THE INITIAL DECISION 
VARIABLES OVER A RANGE OF POSSIBLE RIGHT HAND SIDE 
VALUES 

For many problems, the constraint coefficients associated with primal decision 
variables are well defined (e.g., utility coefficients or network structure), however the right 
hand side (e.g., projected demand) can only be predicted to lie within some range. 

Section A defines the optimal objective function value as a function of the right 
hand side. A linear programming example illustrates that even when two right hand sides 
*0 and bi have the same initial period optimal decision variable (x^), this variable may be 
suboptimal for some Z»=((l-e)i>o +0&i. 0<e<l). This section also proves the optimal objec¬ 
tive function value for a bounded finite dimensional minimization linear program, is a 
piecewise continuous convex function over the convex combination ((1 -0)i>o +^b i, O<0< 1). 

Sections B through E use the results of section A to develop an algorithm which de¬ 
termines if a specific Xg is an optimal solution for all b= ((l-0)i>o +0^1’ 0<Q<1). 

Section F expands on the results of section E, by developing an algorithm to deter¬ 
mine the potential worst case impact of using Xg for any b= ((l-0)6o 0<Q<1). This 

algorithm generates a monotonic non-increasing sequence of upper bounds on the error, 
and is guaranteed to terminate after a finite number of iterations. 

Section G extends the algorithm of section F for primal and dual equilibrium ap¬ 
proximations. The algorithm still generates a monotonic non-increasing sequence of upper 
bounds on the error associated with the infinite-horizon optimal objective function value 
when Xo= Xg for b= ((l-0)i»o The only limiting factor is that after some fi¬ 

nite horizon, elements of b must eventually become invariant in order to define the dual and 
primal equilibrium approximations. 
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A. PROBLEM DEFINITION/PRELIMINARIES 

Consider the problem LP07: 

LP07 

hiQ) = minimize cx 
Subject to: 

Ax^ {d)bj+ {l — B)bQ 
x>0. 

Where a:={xo, Xj,X 2 ,...Xn},a feasible set of decision variables for the right hand side 
(Q)bo + (7-0) bj, (O<0<7) which represents some range of interest. LP07 is assumed to have 
a finite optimal for all O<0<7. 

Now assume that for 0=0, and for 0=7, there exists an optimal 
{Xg, Xj, JC 2 , ...} = a:® withxo=jCo. Further, assume thath(d) is finite over the range O<0<7. 

Is xo=Xo part of an optimal solution for all O<0<7? This is not assured in general. Consider 

the following problem: 

LPEXl: 

Minimize 
Subject to: 

-Xo + Xi>0 

-Xq-Xj>%{-4) + (7-0) (-2) 

-2Xq + Xj>-1 
-2xq -Xj>-5 

Xq,Xj>0. 

This problem has the optimal solution values illustrated graphically by Figure 4. 
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Figure 4. 

Behavior of optimal Xq. 


To derive an algorithm which determines whether jro=X(, is part of an optimal solution for 
all 0<Q<1, we require Theorem 1. 


Theorem (1): Given h{&) is finite for 0<e<7, h{Q) is a piecewise linear convex function 
over O<0<i, continuous over O<0<7, and has only finitely many points of non-differentia- 
bility. 

Figure 5 illustrates the functional relationship between ^(0) and 0: 
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Figure 5. 

Piecewise linear convex function with a finite number of non-differentiable points. 
Proof. 

The dual formulation of h{Q) is: 

^ (0) = maximize tc ((0) f - 0) bf) 

Subject to: 
tiA <c ; 

K>0. 

Given h(d) is finite over 0<Q<1, then for each 0, there exists a dual extreme point optimal 
solution. Also note that the dual feasible region has only a finite number of possible 
extreme points. Accordingly, the dual formulation is equivalent to: 

h (0) = {tt* ((0) bj + {1- 0) 6^) } ^ 

where l<i<k are the extreme points of the dual feasible region. Therefore, ^(0) is the 
maximum of a finite number of linear functions with respect to 0. 

Proof that h(Q) is convex with respect to 0 over the range 0<Q<1. 

Let 0 1 and 02 be any two elements of the set [0,i]. For any A, e (0,1) , 
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+ {1-X)Q^ = max y <;<jt (^®y + (■? -^) 02 ^ +* 0 (^ “ (^^y + (-^ ^ • 

The right hand side is equivalent to: 

max y<,-<jfc{’’^*[*y(^ 0 y+ ('^-^) 02 ^ +^q0^+ “ ^) “ (^ 6 y + (•?-^) 62 ))J ^ 

= max [X(bjej+ {1-Q^)b^ + (7-A,) ( 6 y 62 + (7-02)V^^ 

^maxj^f^^ {Xn (fty 0 y + (1 -Oj)bQ) } +fnaXj^.^j^ { (1-X) n (*y 92 + ~ ^ 

= lmaxj^i^^{nibjej+ il-Qj)b^)} + (i-X) max^ <y {n (fcye2 + (7-e2)V> 

= XhiQj) + {1-X)h{%2) ■ 

Therefore: 

h (XQj + XQ 2 ) < Xh (Qj) + il-X)h ( 02 ) , and HQ) is convex with respect to 0. 

Proof that h{Q) is continuous with respect to 0, over the range 0<Q<1. (A proof is provided 
below. An alternate proof can be found in Rockafellar (1970)). 

For this part of the proof, we rely on the fact that ^(0) is convex, and reference the follow¬ 
ing lemma (Royden, (1988), pp 113): 

Lemma: If/is convex on any open interval (a,b), and ifx, y, x', y' are points of (a,b) with 
x^'<y', and x<y<y', then the chord over {x',y') has larger slope than the chord over (x,y); 

thatis. (/W-/W) < (/W,-/W) .. 

y-x y -X 

We use this lemma to prove that /i(0) is continuous for any (0;, 02 ) c [0,1] . 

Given any (0/, 02 ) c [0, i] , where 02 > 0 i, one can find anx, y, x', andy' such that 
O<x< 0 i< 02 , O<x<y< 02 , and 0i^'<y'<7, 0 i< 02 <y'</. From the lemma we obtain: 
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Since ^(6) is defined and bounded over the interval [0,1], it is clear from the above that 
there exists some finite number such that; 


-M< 


02 - 0 ; 


<M; 


or that [A ( 02 ) \ <M| 02 - 0 ;| • 

Now let 5=8/M. Then for any l02-0il<8, \h (^ 2 ) -h (0;) | < e • Therefore, hid) is continu¬ 


ous. 


Prove that the function hid) has only finitely many points of intersection (i.e., non-differ- 
entiable points). 

The following property is required: 

Property X: Given hid{) = 7t'*((0i)6] + (7-0i)&o)> hidf) = 7t‘*((02)^l + (^'02)^0)’ 
6 )<0 i<02 ^7, then ^(0) = 7U^*((0)&i + il-d)b(fi for all 0 j< 0 < 02 . 

Proof of Property X\ There exists a 7t'* that satisfies the hypothesis since hid) exists and is 
finite for all 0<d<l, and there are only finitely many dual extreme points, Now, assume 
the claim is not true. Then there exists at least one 0 (0i<0<02),where 0=X.0i +(1-A,)02 

for some X iO<X<l), and another extreme point nf such that 

jij[(X,9£ +(1-X)e2)6i + +(l-^)02))ftol>’^'*fi^®i +(1-^)92 )^i + +(1-X,)02))fto]- 

Rearranging both sides one obtains the equivalent expression: 

uj(e,Ai+(i-ei)&o)+(i-^W(02*i+(i-02)*o)>^’i‘*(0i*i+(i-®i)^o)+(i-^W*(02*i+(i-e2)*o)- (i) 

However note from the hypothesis that Ji;**((0i)6i + (7-0i)fto)^'^((0l)^l (-^'01)^0) since 

hidj) = max^^^TZ iidf)bil-df)b^ =n iidj)bil-dj)b^) .Since 

0<X<1, this implies that X-7cj*((0i)6i + (i-0i)7>o)-)''^**((0l)^l (^■0i)^o)- Similarly, 



(l-?i)7tj((02)&l + (i-02)&o)^(l-^)^‘*((®2)*l + U-h^h)- Adding both sides of these two 
equations together one obtains: 

?o7lj(0,6i+(l-0i)6o)+(l-?^W(e2*l+(l-02)*o)^^"‘*(01*l+(i-®l)*o)+(l-^K*(Q2*l+(l-62)&o)- 
A contradiction with equation (1). 

Therefore, given any two points 0i and 02, for which Tt'* is an argmax dual extreme point, 

then, 7t** is an argmax dual extreme point for the interval [0^, 02 ]. 

QED (PropertyX) 

Now using Property X, it is clear that given any two disjoint intervals for which 7t** is the 
max dual extreme point, i.e., [0], 02 ], [ 03 , 04 ], where 0 j< 02 < 03 < 04 , that 7c'* is the max 

dual extreme point for the interval [ 02 , 04 ]. Therefore each 7t* is either: 

•Not an max dual extreme point for any 0 (O<0</). 

•An max dual extreme point over a single closed interval [02, 02]- 

•An max dual extreme point over a single point 0. 

Therefore, each max dual extreme point is tied to only one unique point or to only one lin¬ 
ear line segment over the interval. Since there are only finitely many dual extreme points, 
there can only be finitely many linear line segments, and therefore only finitely many 
points of intersection possible over the domain of 0 {i.e. given k dual extreme points, a 
max of k-1 points of non-differentiability). Therefore, ^(0) is a convex, piecewise linear 
function with only finitely many points of non-differentiability. 

QED {Theorem (1)) 
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B. EXAMINING THE STABILITY OF Xo FOR 0<e<l 

Consider the linear program LPQ2: 
z (Zj, Zq, bj, bg) = Minimize cx- (0Z; + (1 -0)Zq) 

Subject to: 

Ax> iQbj+ (/-6)6(,) 
x>0,0<Q<l; 

and the linear program LPQ3 (where Xg is the optimal Xq for LP6i with 0=0): 

hr (Q) = minimize cx 
Subject to: 

Ax>bjiQ) +bQ(l-d) 

Xq = Xq 

x>0. 

Assume thatXo=Xo is a feasible solution for any O<0<i (e.g., the feasible region repre- 

Ir 

sented by Ax^j is a subset of the feasible region represented by Ax^q). Define x as a 

set of optimal decision variables to LP05 with 0=7, and x^'' as a set of optimal decision 
variables to LP05 with 0=0. Now let Zi=hr(l), (the optimal objective function value 
obtained from LP05 with 0=7) md Zo=h{0)=hr(0) (the optimal objective function value 
obtained from LPQl with 0=0). 

Over all choices of 0, LP02 seeks to maximize the distance between the optimal ob¬ 
jective function value of LP07 (i.e., h(Q)), and the convex combination ofZ| andzQ- Figure 

6 illustrates graphically the optimal solution. 
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Figure 6. 

Graphical representation of an optimal solution to LP02 in terms of 0. 

Note that the optimal solution occurs at a point of intersection for the continuous piece- 
wise linear convex function h(Q) or at 0=/. 

Theorem (2) \z {Zj, Zo,h„ bg) | >^r (0) -h (0) V0, 0<Q<1. 

Proof: 

Clearly 0x^''+(l-0):»:^'‘ generates the objective function value of 0zi+(7-0)zo, and 
O<0<i is feasible to both LP07 and LP05 since 0Ax^''>0fti and (i- 
Q)Ax^’'>{l-%)bQ, which implies that A[0x^''+(l-0)jc^''] > 0*i+(i-0)7»o andar^'' andboth 
contain a:o=JCo . Because LP05 is a restriction of LP0i we have /i(0)^r(0). By convexity, 
we also have M0)^0Zi+(^0)zo- Therefore ^(0)^r(0)<0Zi-i-(i-0)zo. Subtracting h{&) gen¬ 
erates the expression O^r(0)-7r(0)<0Zi+(7-0)zo" Hence; 

max (0z,+ (i-0)Zrt-/t (0)) >hr{Q) -/t(0) . The proof is complete by 
0<Q<1 ^ 

noting that the left hand side of the above inequality is -z (z j, Zq, b j, bf) . 

QED {Theorem (2)) 
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Theorem (2) shows that solving LP02 provides an upper bound on the error possi¬ 
ble by fixing Xq = Xq for any right hand side range specified by O<0<i. This theorem is 

used throughout the rest of this chapter. This theorem provides a basis to verify whether or 
not a particular initial decision variable(s) is optimal over a range of right hand side values 
and to generate reasonable error bounds for the initial decision variable(s) of a particular 
right hand side, given these decision variable(s) remain fixed over a range of potential right 
hand sides. 

C. SPECIAL CASE: THE OPTIMAL VALUES FOR Q=0AND 1 HAVE 
THE SAME BASIS 

Define x^ and x^ as the optimal decision variables to LP0/ for Q=0 and 1 respec¬ 
tively. If andx^ have the same optimal basis B, /j(0)=0Z7+(/-0)zoand the basis stays fea¬ 
sible over the range of 0 since QBx^=ebj, (i-0)fiAr^=(i-0)&O. which implies 
BiQx^+(l-Q)x^=Qb]+(l-Q)bo. Since the max dual extreme point 7t**= is the same for 
both hiO) and h(l). Property X provides that for all 0<Q<1, 7t'* is a max dual extreme 
point. It is important to note thatx® and having the same basis implies 
/t(0)=0Z7+(/-0)Z(9, however ^(0)=0z;+(i-0)Zp does not necessarily imply that x^ and x^ 
have a common optimal basis. 

D. ALGORITHM XqOPTIMAL: DETERMINING IF Xo IS OPTIMAL 
FOR 0, O<0<1 

The following algorithm determines if Xg is optimal for O<0<7. 

(1) Set i ‘-7, 0lower(*)‘'^> ^upperC*')*'-^- 

{Evaluate until discover Xq not optimal or until all points of non-differentiability 
of 7t(0) examined} 

(2) While i>7 Do 
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(3) 

(4) 

(5) 

( 6 ) 


(V) 

( 8 ) 


(9) 


( 10 ) 


( 11 ) 

( 12 ) 

(13) 

(14) 

(15) 

(16) 


(17) 

(18) 


{Set objective function values and appropriate RHS for interval of interest} 

2o(^')*”^^(®lower(*)) 

Z1 (0 ^^^(0upper(*)) 
i»o(0-(^eiower(0)*0+(Ol ower (0)^-1 
b 1 (*)*" (^"Oupper(0)^0"*'(Oupper(0)^ 1 

(Solve for maximum difference between LP01 and feasible convex combination 
over 0 interval of interest} 

Solve LP02. Difference^z (Zj (i), Zo(i), bj ( 0 , ( 0 ) 

0 ^ optimal 0 generated by solving LPQ2 

(Convert 0 of scaled interval back to original 0<Q<1 interval} 

0(0 ^ (0/„..r(O) (i-e) + i^pperii)) (0) 

(Determine if LP01 lies on line generated by convex combination} 

If (Difference=0) then... 

(If Difference =0 and i=l, then either first iteration has shown objective function 
lies on convex combination line, or all possible non-differentiable points have 
been identified} 

If (/=i) then... 

Stop, Xo optimal for O<0<i 

Else 

i^i-1 

Endif 

Else 


(Determine if optimal at point of non-differentiability of LP0/} 

Solve LP07, Zfree-hiQ (i) ) 

Solve LPQ3, Zrestricted*-hr{Q (i )) 

(Implication is if Zfree<Zrestricted, then Xq cannot be optimal to LPQl} 
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(19) \f {Zfree<Zrestricted) then. 

(20) Stop, Xq not optimal for 0<Q<1 

(21) Else 

{Set up next division of interval, splitting original interval into two 
new subintervals} 

( 22 ) Slower (0 (i) 

(23) ^upper (0 ^ ^upper (0 

(24) e 

lower lower (i) 

(25) Q„pperii+1) 

(Increment i to reflect additional subintervals need to be tested} 

(26) i-i+1 

(27) End If 

(28) End If 

(29) End While 

This algorithm systematically identifies (if needed) each non-differentiable point 
for h{Q), terminating only when the algorithm identifies a non-differentiable point where 
Xf, is not part of the optimal solution, or after visiting all non-differentiable points. Termi¬ 
nation is guaranteed since there are only a finite number of non-differentiable points. If Xq 
is optimal for all the non-differentiable points, then Xg is optimal over the entire range of 
9. Figure 7 illustrates the first two iterations of this algorithm, and Figure 8 illustrates the 
behavior of this algorithm on problem LPEXl (from Section A). 
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Figure 7. 

Algorithm to determine if Xq is optimal for 0, 0<B<1. 



Figure 8. 

Illustrating algorithm JCoerror using LPEXl. 


E. AN UPPER BOUND ON DEVIATION FROM THE OPTIMAL 
OBJECTIVE VALUE WHEN Xo IS FIXED OVER O<0<1 

Whether or not xl^i^x'o, we still desire to know how good the initial decision 

xl = Xo is over the range of 0, 0<Q<1. Given Xq is feasible over the range, it is possible to 
generate a simple upper bound on the potential error associated with this decision variable 
over the range of 0. To illustrate the concept involved, determine the optimal objective val- 
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ue of LP07 for 9=0, and set Zo=h(0). Now fix Xg = and solve LP93 fixing 0=7. Set 
Zi=hr(l). Now solve LP92. Figure 9 graphically illustrates the result; 



Figure 9. 

Generating an upper bound on the error associated with Xg. 

By convexity (0)z;+(7-0)zo> h{9), and (0)z;+(7-0)zo^ hr(9) (with a;o=-^o)- The 
maximum difference between h(9) andzy(0)+Z()(7-0) occurs either at a point of non-differ¬ 
entiability ofh(9), or at 0=7, and the resulting solution to LP92, \z\, provides a weak upper 
bound on the error associated with using Xg over the entire range of 0, 0<9<1. This suggests 
an algorithm can be developed to generate a sequence of non-increasing bounds on the dif¬ 
ference between hr(9) and 7e(0); i.e., the error associated with using Xo=^o. 

F. ALGORITHM GENERATING NON-INCREASING 

UPPER ERROR BOUNDS 

The following algorithm generates a non-increasing sequence of weak upper 
bounds on the error associated with using Xg over the entire range of 0, 0<9<1. This algo¬ 
rithm is similar in many respects to XQOptimal. 


102 



{Initialize Algorithm} 

(1) Set d^-l, i *~1, ^\Qy/Qj;(d,i)'-0, 

(2) Set MaxDiff^O, Maxd-Maximum number of iterations. 

(Evaluate until best upper bound found} 

(3) While (i>l and d^axd) Do 

(4) Divd^O, imax^O 

(5) While (i>l) Do 

(Solve for objective function values (LPQ3) and appropriate RHS for interval of 
interest} 

(6) Zo(0*“^^(®lower(^4)) 

(7) Zj(i)^hr(Q^pp^^(d,i)) 

(9) ^/(0*”(7"6upper(^4'))^O"*'(®upper(^’0)^l 

(Solve for maximum difference between LPQl and feasible convex combination 
over 6 interval of interest} 

(10) So\\e LPQl. Difference ^ \z (Zj (i), Zoii) , b, (i) , boii))\ 

(11) 6 <- optimal 0 generated by solving LPQl 

(Convert 0 of scaled interval back to original O<0<7 interval} 

(12) 0(0^ (0 ) (7 - e) + (Qupper (0 ) (0) 

(Determine if LP0i lies on line generated by convex combination} 

(13) If (Difference=0) then... 

(If Difference =0 and d=l the first iteration has shown optimal objective 

function lies on convex combination line} 

(14) If (d=/) then... 

(15) Stop, Xq optimal for O<0<1 

(16) Endif 

(17) Endif 

(18) If (Difference >Divd) then 
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(19) 


Divd*-Dijference 


Endif 

{Set up next division of interval, splitting original interval into two 
new subintervals} 

(20) 0,„^^^(J+i,/max+i) <-9(0 

(21) Supper {d+l imax+1) 9 Upper {d.i) 

(22) {d+l,imax+2) <r- {d,i) 

(23) Q„pper{d+l,imax+2) 

(24) imax^imax+2 

(25) i-i-1 

(26) EndWhile 

(27) If (Divd=0) 

(28) MaxDiff'-Divd 

(29) Done 

(30) Endif 

(31) If iDivd=MaxDijf) 

(32) Done 

(33) Else 

(34) MaxDijf^Divd 

(35) d^d+1 

(36) i*-imax 

(37) Endif 

(38) EndWhile 

This algorithm generates a non-increasing sequence of error bounds (MaxDiff). The 
first iteration “J= 7” solves for the maximum distance between the objective function de¬ 
fined by the convex combination of optimal objective function values Zq (best value using 

RHS Bq), and zi(best value using RHS 7>i restricted to include Xo=Xo). This maximum oc¬ 
curs at some point 9. This is illustrated by Figure 9. The second iteration “d=2” solves for 
the maximum distance between the convex combination of optimal objective function val¬ 
ues Zq and hr (Q) , and the convex combination of optimal objective function values 

hr (9) andzj. This iterative process continues with the number of steps for each division 
potentially growing by a factor of two for each iteration. The number of iterations for each 
division can be reduced if one uses the distances obtained from the previous division to as- 
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sist in determining the most appropriate sections to examine. However, the purpose here is 
to illustrate the basic concepts. 

Figures 10 and 11 show the XoError algorithm executed on a hypothetical example. 
Figure 12 illustrates x^Error for the example problem LPEXl. 



Figure 10. 

Error bound generated after first two iterations of XoError. 












Figure 12. 

Illustrating algorithm XQError using LPEXl. 

G. BOUNDING THE ERROR ASSOCIATED WITH LPoo INITIAL 
DECISIONS 

Figure 13 shows an infinite-horizon problem that may be bounded by using primal 
and dual equilibrium approximation. 


Minimize cXq + ^ a ^cx- 
i = } 

Subject to: 



^0^0 

II 

(0) 

HjXq-\- AXj 

= bj 

(1) 

H2Xq^ KjXj+ Ax2 

= ^2 

(2) 

H^Xg^ K2 Xj-\- KjX2-^ AXj 

II • 

(3) 

HjJXQ~\~ — ^L — 2^2'^ ’ 


(L) 

^ 1~^ ^L-'1^2’^ ^L’-2^3 


(L+l) 

^L^2~^ ^L — 1^3 




x.>0 {i=0,l,2,...) 

Figure 13. 

Illustration of LP°° for which primal and dual equilibrium approximation is applicable. 
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Further assume, that for some k, bn=bn+i, for all n>k. Also note that the dimension¬ 
ality of ;ir;, X 2 , X 3 ,... may differ from Xg . Chapter 2 illustrates that both primal and dual equi¬ 
librium approximations can be used for the problem illustrated in Figure 13. 

This section uses the following notation: 

Aj, the coefficient matrix associated with dual equilibrium approximation; 

Ap, the coefficient matrix associated with primal equilibrium approximation; 

C(j, the cost vector associated with dual equilibrium approximation; 

Cp, the cost vector associated with primal equilibrium approximation; 
jC(j, the decision variables associated with dual equilibrium approximation; 
jCp, the decision variables associated with primal equilibrium approximation; 
b, the right hand side of any infinite-horizon formulation; 

bQ,bj, infinite right hand sides of interest such that for some k, b^=b^^i, for all n>A:; 
6(0)=(l-6)6o+6Zi;, 0<9<7, any right hand side value defined as a convex combina¬ 
tion of Z>o and ftj; 

7»p(0), the right hand side of ^(0) in the primal equilibrium approximation; 

7>^0), the right hand side of ^(0) in the dual equilibrium approximation; 
hp(Q), the optimal objective function value for the primal equilibrium approxima¬ 
tion with right hand side value b(B)=(l-Q)bQ+Qbj‘, 

hpr(Q), the optimal objective function value for the primal equilibrium approxima¬ 
tion with right hand side value b(Q)={l-Q)bQ+Qb], including restricting initial decision vari¬ 
ables to optimal values associated with right hand side bg, and 

hdiB), the optimal objective function value for the dual equilibrium approximation 
with right hand side value b(B)={l-Q)bo+Bbj. 
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The following useful relationships hold for primal and dual equilibrium approxima¬ 
tions: 

•Given any 0<e<l, and any b{%)={\-Q)bo+^bj, the primal equilibrium approx¬ 
imation optimal objective function value is greater than or equal to the dual 
equilibrium approximation optimal objective function value, i.e., 
hp{Q)^d((d). 

•Let Xg represent a optimal solution for a set of initial decision variables to the 
primal equilibrium approximation evaluated at b^. Now fix the initial deci¬ 
sion variables to the primal equilibrium approximation to Xg, and assume that 
for any t)<0<7, that Xg is feasible over the primal feasible region defined by 
bp{Q) and solve for optimal solution of this restricted primal equilibrium for¬ 
mulation for any 0, hpr(Q). Then hpr{%) is finite and hpr{Q)^p{&) for all 
0<Q<1. 

The relationship between hpriQ), hpiQ), and hdiQ) is illustrated by Figure 14. 


<u 



Figure 14. 

Illustration of the relationship between hd(Q), hp(Q), and hpr(Q). 
(hpr{Q)^piQ)^d(Q)) 

This relationship can be exploited to obtain an upper bound on the error associated 
with fixing initial decisions associated with right hand side bQ. 
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Consider the linear programs: 

LPooQl 

hd(Q) = Minimize CjX^ 

Subject to: 

X = {Xq, Xj, X 2 , • . -X^) > 0. 

LP'^Q2: 

Z (Zp Zq, bp Bq) = Minimize - {ZjQ + Zq(1 - Q)) 
Subject to: 

A^x^>bj{Q) +bf){l-Q) 

x>0,0<Q<l. 


LP^QS: 

hpr (Q) = minimize CpXp 
Subject to: 

Xq^Xq 

x>0. 

Algorithm xo^rror with only slight modifications can be applied to iteratively gen¬ 
erate improving upperbounds on the gap between hpr(Q) and /trf(0). 

Algorithm XQError°°: 

{Initialize Algorithm} 

(1) Set d=l, i =7, 6jower(^’^')~^’ 0upper(^’*)“'^’ 

(2) Set MaxDiff-0, MaxJ-Maximum number of iterations. 

(Evaluate until best upper bound possible found) 

(3) While (i>l and d^axd) Do 

(4) Divd-O, imax^O 

(5) While (i>l) Do 
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{Solve for objective function values (LP<»03) and appropriate RHS for interval of 
interest} 

(6) Zo{i)-hpr(3x ower id,i)) 

(7) Zjii)'~hpj'(Q^ppQj(d,i)) 

( 8 ) bQ(i)^{l-QiQi^Qj;(d,iy)bp{0)+{QiQ-^Qj-id,iy)bp{l) 

(9) bj{i)*-( 1 -6upper(^’*))^p(0)+(6upper(‘^>0)^;7( ^ ) 

(Solve for maximum difference between LP°°B1 and feasible convex combination 
over 0 interval of interest) 

(10) SolveLPOO02. Dijference-\z {z, (/), Zo (0, bj (i), bo(i) ) | 

(11) 0 optimal 0 generated by solving LP~02 

(Convert 0 of scaled interval back to original O<0<i interval) 

(12) 0(0 <r- (0/(,wer(O) (7-9) + (^upperi^)) (®) 

(Determine if LP°°Q1 lies on line generated by convex combination) 

(13) If {Difference=0) then... 

(If Difference =0 and d=l, first iteration has shown optimal dual equilibrium 
objective function lies on convex combination line that provides an upper bound 
for the restricted primal. If this holds, then primal equilibrium equals dual 
equilibrium, and the infinite optimal solution has been obtained, and Xq is an 
infinite optimal initial decision variable) 

(14) If ((i=7) then... 

( 15 ) Stop, Xo optimal for O<0<7 

(16) Endif 

(17) Endif 

(18) If {Difference>Divd) then 

(19) Divd^Difference 

Endif 

(Set up next division of interval, splitting original interval into two 
new subintervals} 

( 20 ) 0 ,„„„ {d+1,imax+1) <- 0(0 


no 



(21) Supper id+1^ imax+1) <- 0 upper (d,i) 

(22) Q lower (d+J,imaX+ 2 ) <—©loH-cr (<^>0 

(23) Qupper id+l,imax+2) <r- 0 (i) 

(24) imax^imax+2 

(25) M-1 

(26) EndWhile 

(27) If (Divd=0) 

(28) MaxDiff^Divd 

(29) Done 

(30) Endif 

{if max gap this division equal to max gap of last division, done, as found best 
possible gap for this algorithm) 

(31) If (Divd=MaxDiff) 

(32) Done 

(33) Else 

(in this case Divd<Maxdiff, so update Maxdiff) 

(34) MaxDiff^Divd 

(Move onto next division) 

(35) d-d+1 

(Set next division starting point) 

(36) i-imax 

(37) Endif 

(38) EndWhile 

Applying algorithm iteratively generates improving upper bounds on the 

gap between hpt{&) and hd{Q). This bound occurs either at a non-differentiable point, or 
at the value 0=7. Figures 15 and 16 graphically illustrate the algorithm. 


Ill 














In the above example, 02, is the point where the maximum gap exists between 
hpj.{<d) and/rrf(0). In this casex^Erraroo would run for one more iteration, generate the same 
gap, then terminate. 

H. SUMMARY 

This chapter develops a method to examine the error potential of fixing the initial 
decision variable(s) for finite and infinite-horizon linear programs, over a linear convex 
combination of potential right hand side values. For solving LP^o, these algorithms can pro¬ 
vide insight regarding the stability of the initial decision variable for the original infinite- 
horizon program as the restricted primal equilibrium approximation and dual equilibrium 
approximation still bound the infinite-horizon optimal. The algorithms of this chapter un¬ 
fortunately are not applicable for MIP<», as the primal equilibrium approximation solution 
hull hp{Q) is neither convex or continuous over 0<Q<1. 

This ability to deal with variations in the right hand side value, provides some flex¬ 
ibility in extending truncated formulations over the infinite horizon as a method for elimi¬ 
nating the end effects associated with a finite horizon. The next two chapters of this 
dissertation apply the developed theory to a real world Lfoo and M/P<». 
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VI. APPLYING PRIMAL AND DUAL EQUILIBRIUM 

APPROXIMATION METHODS TO QUANTIFY END EFFECTS 
FOR LINEAR PROGRAMS 

This chapter examines the capability of primal and dual equilibrium approxima¬ 
tions to bound the infinite optimal objective function value and quantify end effects for a 

large scale, military manpower planning model'^Clinear program). This is the first real- 
world example, known to the author, to use both primal and dual equilibrium approxima¬ 
tions to quantify the impact of end effects and provide feasible near optimal solutions to the 
infinite-horizon problem. The methodology proves highly successful applied over a rela¬ 
tively short solution horizon. Dual and primal equilibrium approximations provide a tight 
bound for the infinite optimal and effectively eliminate key end effects found to adversely 
influence the optimal solutions provided by finite-horizon formulations. Section A pro¬ 
vides a brief summary of research conducted using LPa= solution techniques. Section B in¬ 
troduces the LP of interest. The Total Army Manpower Life Cycle Model (TAPLIM) and 
the Future Personnel Extension (TAPLIM/FPS). The TAPLIM series of models are cur¬ 
rently used by the Directorate of Military Personnel Management, Deputy Chief of Staff 
for Personnel, United States Army (ODCSPER) as decision aids for setting personnel re¬ 
cruiting, hiring, promotion, and retention policies. Section C provides a detailed formula¬ 
tion of TAPLIM/FPS. This section derives a modification to the original TAPLIM/FPS 
model structure that more fully integrates the FPS extension. Section D extends TAPLIM/ 
FPS to an infinite horizon problem and derives dual and primal equilibrium approxima¬ 
tions. Section E examines TAPLIM using primal and dual equilibrium approximation 
methods. Analysis and results illustrate the power of the primal and dual equilibrium ap¬ 
proximations to bound the infinite optimal solution and capture and quantify end effects. 


See Gass (1991) for an overview of approaches used in military manpower planning models. 
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Section E also examines the impact on the initial decisions of varying the right hand side 
over a functional range. Section F summarizes the key results of this chapter. 

A. BACKGROUND 

The focus of past research on end effects has been convergence of the optimal so¬ 
lution for primal and/or dual equilibrium approximation methods to an optimal solution for 
the infinite horizon problem. Grinold (1971,1977) and Svoronos (1985) derive problem 
structures that assure convergence of the primal and/or dual equilibrium approximations to 
an infinite horizon optimal. From this, inferences are made regarding the impact of end ef¬ 
fects on initial period solutions. In general, however, whether or not the primal and/or dual 
equilibrium approximations converge to an infinite horizon optimal is not critical to the 
practical implementation of these methods to bound the infinite optimal solution. As long 
as primal and dual equilibrium approximations are found that generate a narrow bound for 
the infinite horizon objective value, then inferences can be made regarding the impact of 
end effects on the feasible set of initial decision variables provided by the primal equilibri¬ 
um approximation. This chapter illustrates that for TAPLIM, convergence does not have to 
be proved to obtain near optimal solutions where end effects are negligible. 

B. TAPLIM/FPS 

TAPLIM is a large scale military manpower planning model originally developed 
by COL Anthony Durso, USA (retired), while assigned to RAND Corporation, Santa Mon¬ 
ica, California. A brief description of TAPLIM and TAPLIM/FPS follows. For additional 
detail, see Durso and Donohue (1994). 

While TAPLIM/FPS forms one model, it is comprised of two distinct sections, 
TAPLIM and FPS. Both are identified. As TAPLIM/FPS is the more general model, it is 
presented first. Section E of this chapter presents the simplified formulation for TAPLIM 
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derived from TAPLIM/FPS by modifying a single index set and removing the constraints 
\vhich generate the FPS extension. 

TAPLIM/FPS examines the dynamics of the Army’s enlisted personnel inventory 
as changes in manning level requirements occur over time. The model has multi-period 
generalized network flows and a relatively large number of side constraints. Durso and 
Donohue use three distinct networks, which are tied together with additional constraints. 
The first network directs the flow of initial enlistees by their initial contractual obligation 
through their first 6 years of service; the second network directs the flow of service years 
for personnel by rate for each time period; the third directs the flow of transfers between 
geographic areas by rate for each time period. The first two networks form the base 
TAPLIM model, and the third forms the FPS extension. Figures 17 to 19 show these net¬ 
work structures: 



Figure 17. 

Network tracking initial enlistees. 
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Figure 18. 

Network tracking personnel by rate and years of service. 



to other areas to other areas 


Figure 19. 

Network tracking movement of personnel between geographic areas. 

The data sets that influence the enlisted force structure include: 

•Billet requirements. Defined by rate for each main geographic area and time 
period (year). Billet requirements reflect area manning requirements. 
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•Total End-of-Year Manpower. This reflects the total number of enlisted per¬ 
sonnel allowed to be on active duty at the end of each period. 

Decision variables include: 

•The number of accessions (new recruits) per year. An implementation of the 
model provided by ODCSPER, fixes the number of accessions for periods 2, 
3,4,5, and 6, (the first 5 periods of the model, as there is no period 1) allow¬ 
ing the variable to float from period 7 onward. Subject to manning require¬ 
ments, the model seeks to minimize accessions. 

•Number of personnel continuing in rate, by years of service, for each time 
period. This decision variable dictates the potential to fill future requirements 
for promotion, and current manpower needs (by rate). 

•The number of personnel selected for promotion to the next higher rate, by 
years of service for each time period. The size of the rate population limits the 
number of promotions to the next higher rate. The model seeks to maximize 
promotions while satisfying manpower requirements for each rate. 

•The number of involuntary separations. This reflects the number of personnel 
by rate and years of service who involuntarily leave the service each time 
period. The model seeks to develop a solution which minimizes involuntary 
separations, as such separations are detrimental to morale, while meeting 
manning and billet requirements. 

•The number of personnel that take some form of early voluntary separation, 
by rate and years of service. Congress authorizes DOD to provide financial 
incentives for selected rates to voluntarily separate prior to the end of their 
enlistment. In the model, voluntary separation occurs at the E-4 and E-5 level. 
The model seeks to minimize voluntary separations, while meeting manning 
and billet requirements. 

•The model deviation between actual manning and billet requirements. The 
model minimizes manning deviations (over or under manning of billets). 

Side constraints that drive the flows across the network structures include: 

•Ensuring initial enlistees encompass minimum proportion of total lower rate 
population base. 

•Fixing attrition losses to a proportion of the total number in the rate. 
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•Retire all E-5’s at the 15 year point in their career, but allow any E-5 with 
more than 15 years at the start of the model to continue to 20 years (known as 
grand-fathering a new policy). 

•Retire all E-6’s at 20 years, and implement early retirement policy for E-7’s. 
•Distribute those selected for promotion by years of service. 

•Control the number of transfers between areas, for each rate. 

•Satisfy minimum manning requirements in each geographic area. 

•Limit upper rate manning levels to a proportion of total rate manning levels. 
•Limit the number of personnel allowed to voluntarily separate. 

ODCSPER implements and solves TAPLIM and TAPLIM/FPS using the Linear In¬ 
teractive Discrete Optimizer, (LINDO), (Schrage, 1991). The LINDO implementation of 
TAPLIM/FPS with some documentation was provided by the Directorate of Military Per¬ 
sonnel Management, Deputy Chief of Staff for Personnel, U.S. Army. The version provid¬ 
ed covers 9 fiscal years, however, because of the model’s staircase structure the number of 
time periods can be easily increased or decreased. TAPLIM/FPS’s periodicity and semi¬ 
invariant staircase structure (i.s., equation and right hand side coefficients from period to 
period become identical from year 9 onward) make the model a candidate for employing 
infinite-horizon linear programs to analyze the stability of initial decision variables as the 
future enlisted force structure of the Army varies. 

C. FORMULATION OF THE TRUNCATED MODEL 

A formulation for TAPLIM or TAPLIM/FPS was not available from ODCSPER. 
Accordingly, this dissertation derives a formulation by examining the LINDO code provid¬ 
ed, and modifies it by: 

•Discounting the objective function. This is commonly used to reflect the 
increased value of choices made today (as they are implemented immedi¬ 
ately), versus choices made for some future time period. Infinite-horizon 
approximation techniques can be used when the objective is discounted. 
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•Expanding the underlying network structure to more effectively track person¬ 
nel by both geographic area and years of service for each time period. The 
separate networks that track the number of personnel by rate and years of ser¬ 
vice and track the number of personnel by rate and geographic location, are 
linked by constraints that match the sum over years of service of a particular 
rate to the sum over geographic areas of the same rate. This leads to feasibility 
problems since connecting the two sub-networks in this way can result in sit¬ 
uations where transfers could never support differences in years of experience 
found for the same rate in a single geographic area from period to period (e.g., 
the number of E-4’s with 3 years of experience in Germany, who did not 
transfer, would not necessarily be reflected properly the next period in the 
number of E-4’s with 4 years of experience in Germany). The new formula¬ 
tion combines two networks (Figures 18 and 19) into a single network track¬ 
ing personnel by rate, years of service, and geographic location (Figure 20). 
This results in a more complex model, with more decision variables, but pro¬ 
vides a more complete underlying network structure. 


Number of rate r-1 , selected for Number of rate “r”, selected for 
promotion to rate r , promotion to rate “r+i”, 

transferring into area “g” transferring out of 

with >7” yems of service, 

in peno t- service in period “r” 

-\ (Includes loss paths) 


rate “r” 


marea g 
with “y” years of 
service, in period 


Number of rate “r” 
transferring into 
area “g”, with “y-7” years 
of service, in period “t-J”. 
(Includes “g” to “g” transfers) 


Number of rate “r”, transferring 
out of area “g”, with 
“y” years of service, 
in period “t” 

(Includes loss paths) 


Figure 20. 

Network flow balance (flow by geographic area and years of service). 


The formulation follows an introduction to notation. 
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1. Indices 

t time period (2,3,4,5,6,...7), (t starting with period 2 reflects the 
starting year (Fiscal Year 1992) provided by ODCSPER); 
y years of service (0,1, 2,...55); 
r rate (E4, E5, E6,... E9); 

c initial contract obligation for enlistees (2,3,4,5,6); 

a transfer areas (boot camp (b), geographic areas (9 areas for TAPLIM/FPS, 
1 area for TAPLM), involuntary separation ( 5 ), voluntary separation (v), 
attrition losses, discharge and/or retirement (/)); 
gb a subset of transfer areas, includes geographic areas and boot camp; 
g, g' a subset of transfer areas consisting of just geographic areas. 

2. Derived Sets 

Derived sets define feasible combinations of indices for both variables and con¬ 
straints. These sets are grouped by the constraint type and/or variables they are associated 
with: transfer/flow balance, losses, tracking of initial enlistees, voluntary separation and 
early retirement, and eligible years of service. 

a. Transfer/Flow Balance Sets 

TALLOW Areas (gb,g) soldiers can transfer between 

(includes transfers from/to the same geographic area (g,g)); 
PCS Geographic areas (g,g') soldiers can PCS transfer between; 

TTOLE Transfer paths (r, gb, a, y) for a soldier that is not selected 
for promotion. This includes transfers to all applicable loss 
areas; 

TTOLP Transfer paths (r, g, a, y) for a soldier that is selected for 
promotion. This includes transfers to all applicable loss 
areas. 
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b. Loss Sets 

TLFLOW Loss paths (r,y) for enlisted personnel who did not select for 
promotion; 

TLPFLOW Loss paths (r,}') for enlisted personnel who were selected for 
promotion. 

c. Tracking Initial Enlistee Sets 

YTOS Allowable {r,y,t) used for tracking initial enlistees through 

their first 6 years of service; 

NOTYTOS Allowable (r,y,t) for other than initial enlistees. This allows 
the selection of appropriate flow loss equations. 

d. Voluntary Separations and Early Retirement Sets 

YV Allowable {r,y) combinations for voluntary separation; 

YER Allowable (r,y) combinations for early retirement (r=E5), or 

selective early retirement (r=E7). 

e. Eligible Years of Service Sets 

YEX Allowable (r,y) for enlisted personnel not selected for 

promotion during a period. Includes all but last year of 
service possible for the rate; 

YEXS Allowable (r,y) for enlisted personnel not selected for 

promotion during a period. Identical to YEX except the last 

year of service possible for the rate is included; 

YPROM Allowable (r,y) for enlisted personnel selected for promotion 
to rate r during each period. 
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3« Ddtn 

The data divides into the following groups; objective function drivers, problem ini¬ 
tialization, manpower requirements, tracking initial enlistment, promotion flows, transfer 
flows, loss flows, and voluntary separations and early retirement. 


a. Objective Function Coefficients 


a 

Discount factor for follow on period objective function 

coefficients; 

WOVERr^g 

Weight of overmanning total for area “g”; 

WUNDER.^g 

Weight of undermanning total for area “g”; 

COSTgg' 

Cost of PCS transfer from area g to area g'; 

CENLIST^ 

Cost per enlistee with contract type “c”; 

Cs 

Cost of involuntary separation; 

^^r.a,y 

Cost of voluntary separation; 

^Pr,y 

Value of promotions. 

b. Initialization Data 

EdaiUj-y 

Number of personnel with rate “r”, not selected for 

promotion, with “y” years of service at problem start; 

Pdata^y 

Number of personnel with rate “r-i”, selected for promotion 

to rate “r”, with “y” years of service at problem start. 

c. Manpower Requirements 

TOP 

The maximum proportion of total enlisted force that can 
comprise the top enlisted rates (E8, E9). Currently set at 

0.05; 

BILLET^gt 

Number of billets requiring rate “r” in area “g” for each 

period “t”\ 
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MAKrgt Minimum number of personnel with rate “r” that must be 
assigned to area “g” for each period “t”; 

PE4 Minimum proportion of all E-4’s that must be new (with 0 

years of service); 

TOTALf Total allowed enlisted manpower in the Army in period 

UMANt Limit on how much the E-9 rating can be undermanned, as a 

proportion of total E-9 manning. For time periods 3 and 4 
only. 

d. Initial Enlistee Data 

PTOScy Proportion of those who signed up under contract type “c”, 
starting the period with “y” years of service, that survive to 
“y+1 ” years of service; 

PTERMf . f The minimum proportion of accessions that must enlist for 

term “c'\ in time period “f”; 

PACCg Minimum proportion of accessions assigned to geographic 
area “g ” for each time period; 

NACCf The number of pre-determined accessions for period 3,4, 

5,and 6. After period 6, the number of accessions becomes 
variable. 

e. Promotion Flow Data 

PROf . f.( PRO r f) Minimum (maximum) proportion of target population 
allowed to be selected for promotion to rate “r”, in time 
period “t”; 

PYRSr,y Minimum proportion of rate “r-i ” selected for promotion to 
rate “r”, by years of service “y”, for any time period. 
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/. Transfer Flow Data 

PPCSr g g,(PP^r,g,g) Minimum, (maximum) proportion of transfers 

for rate “r” out of area “g” that go to area “g' 

TPCSj.g Minimum proportion of area force total with rate “r”, that 
must transfer out of area “g” for each time period. 

g. Loss Flow Data 

PLOSSj .gXPLOSS .g) Minimum (maximum) proportion of total 
rate “r” losses, for each area “g”; 

NLOSSry Proportion of total {r,y) population lost to normal attrition 
(Honorable discharge, retirement, etc.). 

h. Voluntary Separations and Early Retirement Data 
PVSEPry Minimum proportion of the total number voluntary 

separations with rate “r”, broken down by years of service 
“y”, for each time period; 

VMAXr t Maximum number of personnel with rate “r”, that can be 
voluntarily separated in period “t”; 

PER^ y Minimum proportion of early retirements of rate “r ”, broken 

down by years of service “y”, for each time period; 

E9R3 Limit the number of E-9’s separated in key year groups, for 

period 3 only. 

4. Variable Definitions 

Fr a,a’.y.t Number of personnel in rate “r ”, starting period ‘T in area “a ”, 

being transferred to area “a' ” with “y” years of service, not selected 
for promotion to the next higher rate in period “t”; 
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p 


r,a,a’, y,t 


ENLIST 


IPROM,yt 


Number of personnel of rate ‘V-i ”, with “y” years of service, in area 

“a” at the beginning of the period, transferred to area “o' ” during 
the period, and selected for promotion to rate “r” during period “t”; 
Number that enlist under contract length “c” in period “t”; 

Number of personnel in their initial service obligation remaining 
that have not been selected for promotion with enlistment contract 
“c”, with “y” years of service, 
for each period “t”=5 onward; 

Number of tracked accessions by contract length “c”, with “y” 
years of service, selected for E-5 in period “t” 


(When y e YPROM("E5", y )); 

UNDERr g f Number of billets that require rate “r" personnel, that are not filled 
in area “g” during period ‘7” =3 onward; 

OVER^g t Number of excess personnel of rate “r” in area “g ” during period 
“t”= 3 onward. 


5. Objective Function and Constraints for the Truncated Model 

The following equations provide the formulation of TAPLIM/FPS for a truncated 

linear program. 
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Objective Function: 


Minimize 

^ 22 ^ ^OVER^ g , + WUNDER^ UNDER^ ^ ,) + 

g r 

cenlist '^ENLIST , + a ( ^ E^ ^ ^ + 

c \(r,a,"s",y) eTLFLOW ^ 

y ^ a, J 2 2 ^ ^r. g, "v", yj'^^r-^rl, g, "v", y, 

{r,y) eYV g 

~^Pr,y 2 2 ^r,g,g',y,t'^ 


(r,j) e YPROM(g,g') e TALLOW 


1 L 2 ^ 

V (f, ^0 e TALLOW V (r, y) e YEX 

Constraints: 


r,g,g',y,t'^ 


2 ^r, g, g', y, t 

{r,y) € YPROM 


^^''E4",“b'',a',"0",2 ~ EdcitClg^Q, 
g 

I Er,a,a’,y ,2 = Eduta,^^ 

{g, g') € TALLOW 

y{r,y) G YEX 


X Er,g,g',y ,2 - Pdata^ y 
g,g'€ TALLOW 

for(r,y) e {(E5,3). (E6,5), (E7,ll), (E8,16), (E9,18)} 


'^ENLlST^f = NACCf 


3<t^ 


ENLIST^ , > PTERM^ ^ x ^ENLIST^ ^ 


\7c,t>3 
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'^^"E4",''b”,g,"0",t-?E£[ X X ^"E4",gb,g,y,t 

g (gb, g) e TALLOWy: {E4,y) s VEX 

PM[ X X ^'’E5'’,g,g\y,?\ 

V e TALLOWy: (E4, y) e YPROM '' 

\/t>3 


X X ^r, gb, g,y,t'^ 

gb: ( gb,g) e TALLOWy: {r,y) e YEX 

X X ^r + l,g',g,y,t'^ 

g': ( g,g) e TALLOWy: (r + l,y)e YPROM 

UNDER^^,-OVER^^, = BILLET 
^r^5,t>3 


X X 

{g, a): (r, g, a, y) e TTOLPy: (r, 3 -) e 

^r./ X X 

V (^gb,a}:(r-l,gb,a,y) e TTOLEy:{r-l,y) e 


- 7, , a,y,t 


PROrA X X ^ 

^ (g,«) •• (r, g, a, y) e TTOLPy: (r, 3 -) e FF/fOM 

\/r^5,t>3 


r, g,a,y,t 


X X 

(g, a): (r, a, 3 -) e TTOLPy; (r, y) e YPROM 


P 

r, g, a, y, t 


(gb, a): (r - 1, gb, a, y) e TTOLEy: (r - l,y) e YEX 


P'r -1, g, a,y,t 


’ ^ (g,«) •• ir, g, a, y) e TTOLPy: (r, 3 -) e YPROM 


r, g, a, y, t 
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y P ,> 

r,g,a,y,t 

(g,a):(r,g,a,y) e TTOLP 

(g ,«) (.r.g,a,y) e TTOLPy: {r, >>) e YPROM 

\fr^5. 


( 14 ) 


^"£4”, "b", g, "0", t - ^ "b", g, "0", t 

g 

\/g, c, f>5 


(15) 


I 

y:{r,y) e YEX 


^r, g, g\ y, t 


y:(r + l,y) e YPROM 


P > 

r + l,g,g,y,t - 




PPCS^ ^ _ 

'’'-g:(g,g')eTALLOW\y:(r,y)sYEX 

'ir,(g,g') e TALLOW,t>3 


X ^r,g,g',y,t'^ 


y:{r+I,y) s YPROM 


r-yl,g, 


(16) 


X ^r,g,g\y,t'^ 


y: {r,y) e YEX 


s 

y: (r l,y) e YPROM 


P < 

r + i, g\ J, t “ 


S 

^ q': (£. 2') € T 


PPCS, 

\fr, {g,g') e TALLOW, 


X 


g,g',y,t'^ X ^r + l,g,g\y,t \ \ 

g':{g,g') € TALLOW"^y:{r,y) e >. (r+A3') e YPROM ^ ' 


^^(17) 


X ( X 

g':{gyg') e PC^y:{r,y) e YEX 


E A- > P , 1 > 

r,g,g\yyt La r-k-Ug^g^yJ 

y:(,r’\-Uy) e YPROM 


TPCS X 

- g.r 


\/rygy t>3 


ig,g')ePCS^y-(r,y)eYEX 


^r,g,g\yj'^ ^ ^r + l,gyg\yyt 

y:{r+l,y) e YPROM 


(18) 


X ^r,g,a,y,t'^ X 

(a, : (r, g, fl, 3>) € TLFLOW (a, y): (r + 1, g, a, y) e TLPFLOW 


P > 

^ r-hlyg^a^yj- 


PLOSS Y 

-r, g,tZ^ 

g 

\/r,g,t>3 


X ^r,g,a,y,t'^ X Pr + l,g,a,y,t 

(fl, >); (r, g, a, y) e TLFLOW (a, j); (r + 7, a, y) e TLPFLOW 


(19) 
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La r,g,a,yj Za 

(a, y): {r, g, a, y) € TLFLOW (a, y) ; (r + 1, gy a, y) e TLPFLOW 


P . < 

r + l,g,a,y,t^ 


PLOSS.^gj'^l X 

g (a, y): (r, g, a, y) e TLFLOW 


E ,+ 

r,g,a,y,t 


(a, y): (r + 1, g, a, y) e TLPFLOW 


P l(19a) 

‘ r + l,g,a,y,t 


X X ^r,gb,g,y,t'^ 

gb:(gb,g) € TALLOWy-(’’>y) ^ 

y y P J , ,>MAN 

^ r-\-l,g,g,y,t - r,g,t 

g'-(g',g) e TALLOWy- (’’ + ><y) « YPROM 

's/r,g,t^ 


X g, "v", y,t'^^r + l, g, "v", y, - 

g 

PVSEP X 

g V_y;(r,3-) € YV 

\fE4<r^5, y:(r,y) e YV, 


S 1 

g y:(r,y) e YV 

yE4<r^5, t>3 




PERr.y^'Ll I <®.. 

g ^y:(r,y) G YER 
'VE5<r^7, y:{r,y) e YER, t>3 


g,"s",y,t'^ ^r + J,g,"s",y, 
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2 S 2 

r y:(r,y) e YEX{gb,g) e TALLOW 

S S X 

r >-. (r + y,j) e YPROM{g,g') £ TALLOW 

Vf>5 




= 7’OrAL, 


(24) 


X X E.^,,g.^.yf<E9R3fort=3,4only (25) 

^ 26<y<29 


E8<r<E9y:{r,y) e YEX(g,g') e TALLOW 


^r,g, g',y,t 


X X ^"E9", g, g', y, t 

y:{E9,y) £ YPROM{g,g') £ TFROM 

Vt>3 


TOPx 


TOTALf 


(26) 


^UNDER,,g. UMANt\ 

g 

t=3,4 


X X ^"E9",g,g\y,t 

(g,g') £ TALLOWy:{"E9'',y) £ 


(27) 


Equation Definitions: 

(1) Initialize personnel levels (both E and F variables) for first period. 

(2) Fix enlistment totals for years 3 to 6. 

(3) Distribute contract options for enlistees. 

(4) Ensure the appropriate losses of new enlistees from initial boot training, for each contract op¬ 

tion. 

(5) Of the personnel that the model takes in as enlistees, ensure the appropriate proportion of per¬ 

sonnel survive into the next period. Survival is defined as not being attrited or promoted. 

(6) Link initial contract personnel to associated variable that tracks years of service and movement. 

(7) Link initial contract personnel to associated promotion variable that tracks years of service and 

movement. 

(8) Balance equations for state r,g,y,f. (The number of personnel in rate r, located in area g, with y 
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years of service, at the end of period f). 

(9) Account for attrition losses ‘T for all those personnel not being tracked over their initial obli¬ 

gations. 

(10) Ensure new recruits comprise some minimum percentage of total E-4 and below manning. 

(11) Match billets to available bodies. Account for under and over manning. 

(12) Limit the number of promotions to be no more than some percentage of the rate population. 

(13) Ensure a minimum percentage of each rate selects for promotion. 

(14) Distribute promotions over years of service. 

(15) Distribute those accessions that make it through initial training over all geographic areas. 

(16) Ensure a minimum percentage of personnel transferred out of area gb go to area g . 

(17) Ensure a maximum percentage of the total transferred out of area gb go to area g . 

(18) Limit the number of transfers out of area g as a proportion of the total number of personnel 

with rate r, during period t. 

(19) Distribute all losses over geographic areas. 

(20) Meet minimum manning requirements. 

(21) Distribute voluntary separations by years of service. 

(22) Limit voluntary separations to maximum authorized. 

(23) Distribute early retirements by years of service. 

(24) Meet total manpower requirements. 

(25) Limit the number of E-9’s separated (for periods 3 and 4 only). 

(26) Limit the number of E-8’s and E-9’s to a proportion of the total enlisted force. 

(27) Limit the undermanning of E-9’s to a fixed percentage of the total E-9 population, (periods 3 

and 4 only). 

For TAPLIM/FPS, the right hand side (RHS) structure becomes invariant from pe¬ 
riod 7 onward as manning requirements stabilize. The equations and their coefficients be¬ 
come invariant from period 9 onward. This allows the formulation to be a candidate for the 
application of LPc® techniques to evaluate the potential influence of either steady state force 
levels, or growth from period 10 onward on the optimal decisions made in the early periods. 
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D. TAPLIM/FPS AS AN INFINITE HORIZON PROBLEM 

TAPLIM/FPS, when defined over an infinite horizon, exhibits the single period 


overlap staircase structure: 




oo 

. . t ^ 3 

Minimize cXq -t- a cx^ 




t = 9 




Subject to: 




^0^0 


= s 


HXq +AXg, 


= b 

{1) 

KXg +AXjq 


= b 

(2) 

KXk_i +Ax^ 


= ft(i + P) 

(k) 

Kx, 

+AXk^l 

= 6(i + P)^ 

(k^l) 

x^>0 

{t=0,9,10,...). 




It is important to note that the variables associated with periods 2-8 of the TAPLIM model 
are contained in the variable jcq since the matrix and right hand side coefficients are not 
invariant (i.e., are not the same from period to period) until period 9. The eventual invari¬ 
ance in the coefficient matrix structure allows the implementation of the dual and primal 
equilibrium approximation methods to bound the problem. Also note the invariant right 
hand side is equivalent to assuming that once stabilizing steady state manning require¬ 
ments (these actually become invariant after period 7), they remain constant until some 
period k. At period k, it is possible to introduce an exponential growth (or decay) of (i+P) 
on the RHS, as long as (7+P)a<L 
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1. Dual Equilibrium Formulation 

The dual equilibrium approximation aggregates all the constraints from period 
(where it=first period of exponential decay/growth, if used) onward with an a discount fac- 

oo 

tor and substitutes JCj- = X ^ . The resulting reformulation: 

t^T 

T-1 

^ — 3 T ^ 3 

Minimize cXq + ^ a cx^ + a cxj, 

t = 9 

Subject to: 


^0^0 

HXq+ AXg 

KXg+ AXjq 



= s (0) 

= bj (7) 

= b2 (2) 

= b^_j {T-1) 


Kxj._j+ 

(aK + A)Xj, 

brp 

7- (7 + p)a^ ^ 


Xf>0, 

{t=0,9,10....). 



Xt = ^x^ and Xj, includes appropriate slack/surplus variables. 

t = T 

bj=b for j<k where k= first period of exponential decay/growth. 

bj=b(l+^y'^ where k= first period of exponential decay/growth, k<j<T. 

The implementation of constraints associated with period T depends on the row 
structure of K, A, and b. For the following sections, k\ and correspond to row i vectors 
of K and A respectively. 

a. Constraints For Which k^=0 

All the TAPLIM/FPS constraints with the exception of the flow balance and 
loss factor constraints fit into this category (constraints 3,4,6,7,10,11,12,13,14,15,16, 
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17,18,19,20,21, 22,23,24,26,and 27). Implementation of the dual equilibrium approx¬ 
imation method needs to simply adjust the right hand side of these constraints. For con¬ 
straints with a non-zero right hand side (11,20,22,24, and 26), this involves changing the 

right hand side for period Ffrom b, to . The revised constraints follow: 


X X ^r,gb,g,y,T' 

gb:(gb,g) e TALLOWy: {r,y) e YEX 

X X + /, g\ g,y,T'^ 

g': {g\g) e TALLOWy: {r,y) e YPROM 

BILLET^ j 

UNDERrgT-OVER^gT = 

Where k=first period of p growth/decay 
BILLET^ g j. = BILLET^ g + 

'^r,g 


(lid) 


X X ^r,gb,g,y,T'^ 

gb:igb,g) € TALLOW^ 


X X ^r + 1, g', g, j 

g':(.g',g) e TALLOWy:(r +1,y) € YPROM 

Where k=first period of p growth/decay 


MANr^^T 

^r + Lg',g,y,T- j _ (i +p) a 


(20d) 


= MAN g{l + ^) 


VMAK^j 

X X g, "v", y,T'^^r + l, g, "v", j. (/ + 3)a 

Where k=first period of P growth/decay (22d) 

VMAX^ j, = VMAX ^^9 (f + P) 

\/E4<r^5 
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E8<r<E9y:{r,y) € YEX{g,g') € TALLOW 


^r,g,g',y,T-^ 


X S ^''E9",g,g',y,T 

y:(E9,y) e YPROM(g,g') e TALLOW 

Where k=first period of P growth/decay 


TOPx TOTALj 
7 - (7 + P) a 


T-k 

Total j. = Total g (7 + P) 


(26d) 


If the right hand side h=0, (constraints 2, 3,4, 6, 7, 11, 13, 14, 15, 16, 17, 18, 19, 20, 22, 
24, and 28), then the constraints associated with period T require no adjustment for imple¬ 
menting dual equilibrium. 

b. Constraints for which jf) 

This structure holds for the flow balance constraints and loss factor adjust¬ 
ment constraints of TAPLM/FPS (constraints 5,8,and 9). In this case, the effected con¬ 
straints must reflect adding the factor aKxj in period T: 


TOSc y T + tP^(^^c,y, jiwhen CE5*\y) € YPROM) = PTOS^y X TOS^y_ 

PTOS^^^xaTOS^^_jj 

Vc, (E4.y,T) e YTOS 


(5d) 
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z 

gb:(gb,g) e TALLOW 
for (r, y-J)€ YEX 

( 


^r,gb,g,y-l,T-l'^ ^ ^r,g',g,y - 1,T -1 

g':(g\g) e TALLOW 


I 

) 6 TA 
for{r,y-l) € YPROM 

I 




“ X ^r,gb,g,y-l,T^ Ld ^ r + l,g\g,y-l,T 

gb: (gb, g) € TALLOW g': (g', g) e TALLOW 

V for(r,y-l)£ YEX for (r +1, y - ^ YPROM 


(8d) 


X ^r,g,a,y,T^ X ^r + l,g,a,y,T 

a: (r, g, a, y) e TTOLE a: (r, g, a, y) e TTOLE 

for (r, y) e YEXS for (r-¥l,y)£ YPROM 

'^r,g,y 


^ r,g,'T,y,T r + l,g,'T,y,T 


for {r, y) e YEXS for [r + l,y) e YPROM 

r 

I 


NLOSS X 
r,y-l 


^r,g\g,y-l,T-l + 


g':(g\g) € TALLOW 


( 


a 


for {r,y~ 1) e YEX 

' I 

g‘:(g'.g) e TALLOW 
for(r,y-I) e YEX 

'^gAr.y.t) e NOTYTOS 


I 

€ TALLOW 
for(r,y-}) € YPROM 


^r,g\g,y-l.T-l 




NLOSS X 
r,y-l 


V 


^r, g\ g, r 


X Tr,g\g,y-LT 

g': (g\g) e TALLOW j 

for {r,y -1) € YPROM 


J 

W 


(9d) 


2. Primal Equilibrium Formulation 

The primal equilibrium approximation for TAPLIM/FPS adds the restriction 
^t+i=(l+P)^t> (i+p)a<i). The finite period re-formulation for 7^ (where fc= first 

period of exponential growth/decay when used) is: 
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r-7 r-5 

_ t-3 a 

Minimize cXq+ ^ a cx^+ (7 + R) 



II 



Subject to: 




= s 

(0) 

HXq+ AXg 

= 

(1) 

KXg+ Ax IQ 

= b, 

(2) 

KXt_j+ Axj, 

= bj, 

(T) 

Kxj,+ AXj. ( -/ + P) 

~ ^T+l 

(T+l) 


bj=b for j<k where k= first period of exponential decay/growth. 
bj=b(l+^y'’^ where k= first period of exponential decay/growth, k<j<T. 

a. Adjusting the Objective Function 

Adjustment of the objective function is easily done by multiplying all period 
T cost coefficients by y _ ^ p ’ 
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Minimize 

( 


T-l 

S“ 

t = 3 


-3 


SI {WOVER^ ^OVER^ ^ ^ + WUNDER^ ^UNDER^ ^ "I + 


g r 
CENLIST 


lENLIST^^ + c^f 2 

c y(r,a,"s".y) e 


E 


TLFLOW 


r, a, "s", y, t 


a,y E X g, "v", j, f + i, g, "v", y, 
ir,y) eYV g 


-Vp, 


r,y 


ir,y) € YPROM{g,g') e TALLOW 


^r,g,g',y,t'^ 


COST 


V {g,g’) € TALLOW 


-J 1 


E, 


r,g.g,y, 


r + 


r,g,g\ yj 


(r,y) e YEX 


{r,y) e YPROM 


T-3 


7-(7 + p)a 


( WOVER^ ^OVER^ ^ y + WUNDER^^ ^UNDER^ j) + 


g r 


CENLIST J^ENLISTJ+Cs^ ^ , 


S ^r,a/'s'\y,T 

(r, fl, "s'\y) e TLFLOW 


+ 


fl, V S X g, "v'\ j;, r + + 7, g. "v", 3 ^, r) 


(r, y) eYV g 


-Vp 

r,: 


(r, y) e YPROM {g, g') e TALLOW 


^r,g,g’,y,T'^ 


COST 


^ {g.g') e TALLOW 


g.g 


X ^r,g.g',y,T + 

(r, 3 -) e YEX 


r, g, g\y,T 


{r,y) G YPROM 


b. Modifying the Constraint Space 

Like dual equilibrium, the primal equilibrium implementation of constraints 

associated with period T depends on the row structure of K. If A:‘=0, implementation of the 
primal equilibrium approximation method requires no change to the constraint set(s) asso¬ 
ciated with the truncated formulation. All the TAPLIM/FPS constraints with the exception 
of the flow balance and loss factor constraints fit into this category (constraints 2, 3,4, 6, 

7,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,and27). WhenA:'Vo, which 
holds for the flow balance and loss factor constraints (constraints 5,8, and 9), an additional 
constraint set must be added to reflect the ties created by the cut Xj(7+P)=Xj+These addi¬ 
tional constraints are listed below: 
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+ = PTOS^.,xTOS^^_,^ 

Vc,(E4,y,T)e YTOS 


(5p) 


X 

gb:{gb,g) € TALLOW 
for{r,y-l) e YEX 


^r,gb,g,y-l,T'^ Ai ^ r,g\g,y-l,T 

g-:(g\g)e TALLOW 


(^ + P) 

'^r,g,y 


z 

a:(r,g,a,y) e TTOLE 
for{r,y) € YEXS 


X 

I e T 

for {r,y -1) e YPROM 

X 

.3') G 

for(r + l,y) s YPROM 


\ 


^r,g,a,y,T'^ Lj *r + l,g,a,y,T 

(/*, gi 3^) ^ TTOLE 


(8p) 


(i + P) 




^ r,g/r,y,T r + 7,f."r,3-,r 

/O'- (z-. J) G FEATS for (r + l,y)e YPROM^ 


NLOSS^ y_jX 


Z ^r,g\g,y-},T'^ Z ^r,g\g,y-l,T 

g': (g\g) e TALLOW g': (g\ g) s TALLOW j 


for {r^y -1) € 

Vg,('r,3;,7; e NOTYTOS 


for(r,y-I) 6 YPROM 


(lOp) 


E. EXAMINING THE IMPACT OF END EFFECTS ON TAPLIM/FPS 

The initial runs of TAPLIM/FPS consist of using the truncated formulation with 
data provided by ODCSPER (i.e., FY-92 to FY-99, with stability in all coefficients occur¬ 
ring in year FY-99), then comparing these results with the dual and primal equilibrium ap¬ 
proximations of the infinite horizon model with manning set to FY-99 steady state levels 
from FY-99 to infinity, (i.e., no growth or decay of manning or billet requirements, P=0). 
Table 1 provides a comparison of optimal objective function values for the truncated, dual, 
and primal equilibrium approximations over the solution horizon FY-92 to FY-99. 
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Dual Equilibrium 
Approximation 

Primal Equilibrium 
Approximation 

Truncated Approximation 

4379 

Infeasible 

2637 


Table 1. 

Comparison of Optimal Objective Function Values for TAPLIM/FPS 


Because TAPLIM/FPS encompasses 9 geographic areas and 6 rate classes for each 
time period, the 8 period models (FY92 - FY99) are large (approximately 59,496 variables, 
16,856 constraints for each formulation). Initial tests generating the model using the Gen¬ 
eral Algebraic Modeling System, GAMS, (Brooke, Kendrick, and Meeraus, (1992)) with 
solvers XA (Sunset Software Technology, (1993)) and OSL (IBM Corporation, (1991)) re¬ 
quire in excess of 24 IBM RS-6000 Model 590 CPU hours. In addition, the primal equilib¬ 
rium method requires a longer solution horizon to satisfy feasibility. This made the model 
impractical for examining longer time horizon dual and primal equilibrium approxima¬ 
tions. 

F. TAPLIM 

In comparing the results of baseline runs of TAPLIM/FPS, to baseline runs of 
TAPLIM without FPS (i.e., eliminate tracking personnel by geographic area), the accession 
and promotion levels are similar for both models. An explanation of this similarity lies in 
the coarseness of the coefficient data provided by the United States Army to drive the mod¬ 
el. Both the promotion and attrition rate data are dependent only on years of service, there¬ 
fore geographic location has only a minor influence on the results (maintaining feasible 
numbers of personnel in each geographic area and feasible transfer flows). The key deci¬ 
sions of interest (number of accessions required, number of promotions, number of invol¬ 
untary separations, number of voluntary separations) can still be addressed effectively 
without the FPS extension. This dissertation uses TAPLIM without FPS to fully examine 
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end effects. To use TAPLIM without FPS, the following modifications to TAPLIM/FPS 
are made: 

1. Indices 

The following are indices modifications: 

a transfer areas (boot camp (b), active duty (j:), involuntary separation 
(i'), voluntary separation (v), normal attrition losses either by 
discharge or retirement (/)); 
gb Active duty plus boot camp (x, b); 
g Active duty only (x). 

2. Derived Sets 

The following are modified sets: 

TALLOW Set of allowable areas {gb,g') soldiers can transfer between 
(includes transfers from/to the same area {g,g)). 

(Modified to be only {b,x), (x,x) .); 

TTOLE Set of allowable (r, gb, a, y) for soldiers not selected for 

promotion during the period. This includes loss areas. 
(Modified to reflect that active duty is the only geographic 
area); 

TTOLP Set of allowable (r, g, a, y) for soldiers selected for 

promotion during the period. This includes loss areas. 
(Modified to reflect that active duty is the only geographic 
area). 
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The following sets are eliminated: 

PCS Set of allowable geographic areas (g,g') for which PCS 

transfers between are possible. 

3. Data. 

The following data changes: 

BILLET^ g t Number of billets requiring rate “r” for area “g” for each 

period “t”. (Modified to Billet^ t 

g 

MANj . g f Minimum number of personnel with rate “r ” that must be 
assigned to area “g” for each period “t”. (Modified to 
= YMAN^y, 

g 

The following data sets are eliminated: 

PACCg Minimum proportion of accessions assigned to geographic 

area “g” for each time period; 

PPCS^ g g< Minimum proportion of transfers out of area “g” that must 
go to area “g' 

PPCS j.g g> Maximum proportion of transfers out of area “g ” that can go 
to area “g' 

TPCSr g Minimum proportion of area force total with rate “r”, that 

can PCS out of area “g ” for each time period; 

PLQSS^ g Assign a minimum proportion of total rate “r” losses, 

to area “g”; 

Floss ^ g Assign no more than proportion of total rate “r ” losses, that 
can be assigned to area “g”; 

COSTg g’ Cost of PCS transfer from area g to area g'. 


145 



4. Modified Formulation 

The following reflects the modified formulation using the original constraint num¬ 
bers with only one geographic area to represent personnel on active duty. Constraints 16- 
19 linked specifically to the geographic transfer flow network are eliminated. Please note 
that the modifications for the primal and dual equilibrium approximations described above 


still apply. 

Objective Function (modified by dropping costs linked to geographic transfer 

flows): 

Minimize 

IS {WOVER^ ^OVERj. g f + WUNDER^ ^UNDER^ ^ 1 + 

I ^ 


1“ 

f = 5 


t-3 


g r 

CENLIST^Yi^NLIST^^ ^ ^ , 


(!■,«,"/» e TLFLOW 


^r,a,"s",y,t 


Cv 


r, a,y 


S S ( g, W, 3 -, t + i, "v", 


(T,y) e YV g 


\ '^Pr,y X X ^r,g,g',y,t j 

^ (r,y) e YPROM{g,g') € TALLOW 


Constraints: 

'^^''E4'\"b”,a',''o",2 ” Edata^^g, 

8 

I = Edata,_^\/(r,y) eYEX (1) 

{g,g^) e TALLOW 


X Er,g,g',y,2 - Pdata^ y 

g,g’e TALLOW 

for(r,y)=(E5,3), (E6,5), (E7,ll), (E8,16), (E9,18) 


(la) 


Y^ENLIST^^ = NACC^ 

c 

for 3<t^ 


( 2 ) 
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ENLIST^ ^ > PTERM^ ^ x '^ENLIST^ , 

C 

'^c,t>3 


TOS^,,q„^ = PTOS^ .q. fX ENLIST^ f 


tos,,,+iprom^^, 


= pros, .xTos 

y 


\,y-ut-l 


Vc, t^, (E4,y,t) G YTOS 


(5) 


'Xi^"E4",b,g,y,t - 
g ^ 

yt>3 


(6a) 


2 ^"E4'\g,g\y,t - Yj^^c,y,t 

{g, g’) € TALLOW c 

y(E4,y,t) € YTOS, 


(6b) 


X ^"E5",g,g\y,t 

(g,g') e TALLOW 

\/(E4,y,t) G YTOS t>3 


= J^IPROM^^, 

C 


(7) 


5]( gb,g,y-l,t-1 

gb:{gb,g) € TALLOW 

for{r,y-l) e YEX 


X ^r,g\g,y-l,t-l 

g’:(g',g) e TALLOW 

for {r,y -1) e YPROM 


X X ^r + l,g,a,y,t 

a: (r, a, j) e rrOL£ «. (r, g, a, y) e TTOLE 

for (r, 3-) e YEXS for (r + 7, j') € YPROM 

\/r,g,y,t>3 


( 8 ) 
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^ r + l,g,"l",y,t 

for (r,y) e YEXS for (r + l,y) e YPROM 




NLOSS^ y_j X 


s 

g:(g\g)e TALLOW 
'' for (r, y-1) G YEX 

\/g,(r,y,t) e NOTYTOS 


^r,g\g,y-l,t-] ^r,g\g,y-l,t-l 

g':(g\g) e TALLOW 

for{r,y-I) e YPROM 


'Yj^"F 4", "h", £, "0", t - PE4i ^ ^ ^"E4",gb,g,y,t 

g ^ igb, g) 6 TALLOWy: (E4.y) G y£Jr 

2 2 ^"E5”,g,g\y,t 

V G TALLOWy:{E4,y) g r/>XOM 

\/t^ 


(9) 


( 10 ) 




2 2 

( gb,g) G TALLOWy: {r,y) 6 

2 2 

( g.g) e TALLOWy: (r + /.j) e YPROM 

UNDER^ ^^-OVER^ ^ , = BILLET^ ^ ^ 
'ir^5,t>3 


+1, g', g,y,t'^ 


( 11 ) 


2 2 ^r,g,a,y,t- 

ig, a): (r, g, a, y) s TTOLPy: (r, y) g YPROM 

PRof X 2 

^ igb,a):(r- Lgb,a,y) g TTOLEy: {r -1, y) e YEX 
(g, a): (r, a, y) e TTOLPy: (r, j) g YPROM 

\/r^5,t>3 


^r-l,gb,a,y,t ' 


( 12 ) 
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Z Z Pr.,.a.,..i 

(S.«). (', *.«, J) s TTOLPy: (r.y), YPROM 

V (gb, a):(r-l, gb, a, j) e TTOLEy: {r -l,y)e YEX ^ 

I I ^r,g,a,y,^ 

V (g^, d): (r, g, a, y) e TTOLPy: (r, 3-) € YPROM ^ 

\lr^5,t>3 


y p ,> 

jUt r,g,a,y,t 

(g, a): (r, g, a, 3^) e rrOLP 

^.,,x z z 

’ (g, «) •• (»•. g.«. y) e 7TOLP3-: (r. 3-) e YPROM 

\/r^5, t>3 


^"E4", "b", g, "0", t - ^A££.g ^ '^^"E4", "b", g, "C 

g 

\/g=x, c, t>3 


X S ^r, gb, g,y,t'^ 

gb;(gb,g) e TALLOWy:(r,y) e YEX 

Z Z ‘•ryJ.Y., 

g':(g',g) s TALLOWy:('*hy) e yPROM 

yr,g,t>3 


+ l,g',g,y,t-^!^^r,g,t 


X g, "v", y,t'^^r + l, g, "v", y, " 
g 

g ^y:(.r,y) e 

\/E4<r^5, y:(r.y) € 77, 


X X g, "v", 3-, < + + 7 , g, "v". 3-, <) " t 

g y:{r,y) e YV 

\/E4<r^5. t>3 
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( 23 ) 


X g, "s", y,t'^^r + l, g, "s", y, P “ 

g 

PERr yX^( X ^^r,g,"s",y,t'^ ^r + l,g,"s'',y,t^ 
g ^y- ir,y) sYER 

\fE5<r^7, y:(r,y) e YER, t>3 


XX X ^r,gb,g,y,t'^ 

r y:(,r,y) e YEX{gb,g) 6 TALLOW 

XX X ^r + l,g,g',y,t 

r y:(r + l,y) e YPROM{g,g') e TALLOW 

\/t>3 


= TOTAL^ 


(24) 


^ ^ E»g„^ g f < E9R3 for t=3,4 only 

g 26<y<29 


(25) 


XX X 

E8<r< E9y: (r, y) e YEX (g, g') e TALLOW 

X X 

y:(E9,y) e YPROM{g,g') e TALLOW 

\/t>3 


^r,g, g', 


E"E9",g,g',y,t - TOPx TOTALt 


(26) 


YUNDER„g„ ^ < UMANt ^ X 

^ ’ ’ (g,g’) e TALLOWy:{''E9",y) e YEX 

t=3,4 


^"E9",g,g',y,t 


(27) 


The original TAPLM/FPS formulation should be used if data can be pro¬ 
vided which breaks down promotion/attrition rates by rate and years of service and geo¬ 
graphic area, and if these rates are significantly different between geographic areas for at 
least some rate and year combinations. However, given the data provided, the reduced 
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model is sufficient to analyze the impact of end effects on the key decision variables of in¬ 
terest (total accessions, total promotions by years of service for each rate, total voluntary 
and involuntary separations by rate and years of service, and deviations from satisfying ac¬ 
tive duty manning requirements). 

G. ANALYSIS AND RESULTS 

This section highlights the results obtained when applying primal and dual equilib¬ 
rium approximations to TAPLIM. The first section looks at an infinite-horizon extension 
of the truncated formulation that assumes steady state FY-99 year manning, from FY-99 to 
infinity, using a 0.9 discount factor. Truncation end effects impact both the accession and 
promotion decision variables. It is shown that the primal and dual equilibrium approxima¬ 
tions generate a tight bound on the infinite-horizon optimal solution and both primal and 
dual equilibrium approximations effectively eliminate the end effects. The second section 
examines the impact of primal and dual equilibrium approximations to capture end effects 
when the discount factor a varies. The choice of a does impact the optimal decisions, how¬ 
ever, even with oc set to a relatively low value of oc=0.5, end effects found when using only 
a finite horizon are eliminated. Sections three through seven examine the variability of the 
initial optimal accession decisions obtained from the zero growth model, under conditions 
of growth in future periods. Section eight uses algorithm (see Chapter V), and it 

proves highly effective, generating a tight upper bound on the error associated with using 
the optimal accession decisions derived under the zero growth assumption, when moderate 
growth occurs in future periods. In all cases, solution run times are quite reasonable. Tests 
using the model generator GAMS with solver OSL, running on an IBM RS-6000, generated 
optimal solutions using between 2 (dual equilibrium, 7 year horizon), and 7 CPU minutes 
(primal equilibrium, 29 year horizon). 
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1. Analysis and Results, Zero Growth (p=0, a=0.9) 


a. Convergence of Dual/Primal Equilibrium Objective Funo 
tion 

Figure 21 illustrates the convergence performance of the primal and dual 
equilibrium objectives as the solution horizon is varied. 



Problem Horizon 

(1) Manpower Requirements Steady State Period 7 onward 

(2) Problem Structure Invariant Period 9 onward 

(3) a=0.9 

Figure 21. 

Convergence of primal and dual objective function values. 

Figure 21 illustrates that for TAPLIM, both primal and dual equilibrium ap¬ 
proximations converge to within 1% within 11 years after the formulation becomes invari¬ 
ant. It is also worth noting that while dual equilibrium is converging slower than the primal, 
it is a closer approximation to the infinite horizon optimal objective function value for both 
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the 10 and 15 year problem horizons. This can be recognized given the infinite-horizon op¬ 
timal solution must be between 524 and 528, as determined from evaluating the primal and 
dual equilibrium approximation methods for a 20 year horizon. 

b. Truncated, Partial Primal Equilibrium and Dual Equilibri¬ 
um Objective Function Values 

Table 2 provides a comparison of period 2 through 9 optimal objective func¬ 
tion values obtained from a 2 to 9 period TAPLIM formulation, and dual/primal partial ob¬ 
jectives obtained from the primal and dual equilibrium solutions over a 19 year horizon 
(periods 2-20). 


Truncated Objective 
Function 

Partial Primal Objective 
Function 

Partial Dual 

Objective Function 

469.16 

491.68 

490.31 


Table 2. 

Comparison of period 2 to 9 objective function values. 


With no end effects in the truncated formulation, the truncated optimal ob¬ 
jective function value should closely match the Primal and Dual Equilibrium partial objec¬ 
tive function values over the truncated problem’s solution horizon. As Table 2 illustrates, 
this is not the case. A gap of approximately 5% exists between both the primal and dual 
partial objective function values and the truncated objective function value. This indicates 
that end effects are potentially influencing the solution of the truncated problem. Table 3 
provides a comparison of the dual and primal equilibrium approximation optimal solutions 
obtained when constrained to include the optimal ENLIST variables of the truncated for¬ 
mulation. 
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Unconstrained 

Constrained 

Difference 

Primal Equilibrium 

528.067 

565.575 

37.508 (7%) 

Dual Equilibrium 

524.284 

538.480 

14.196 (3%) 


Table 3. 


Comparison of primal and dual equilibrium approximations. 

The constrained version has the value of Enlist^ ^ set to the optimal truncated solution. 

As Table 3 illustrates, the optimal accession choices of the truncated formu¬ 
lation are feasible, but sub-optima for both the primal and dual equilibrium approximations. 
Given the infinite optimal objective function value lies between the primal and dual objec¬ 
tive function values (524.284,528.067), it is clear that the truncated decisions are feasible, 
but sub-optimal, since the best possible infinite horizon objective function value using the 
truncated formulation decisions is 538.480, yet the infinite optimal lies at or below 
528.067. End-effects are influencing the choices made by the truncated formulation. 

c. Examining Accession Decision Variables (ENLIST 

Given that end effects are influencing the accession decision variables, the 
next goal is to try to determine how these variables are being influenced by end effects, and 
then to determine whether solutions derived from Dual and/or Primal Equilibrium approx¬ 
imations effectively minimize or eliminate this influence. Tables 4-6 provide the optimal 
decision variables (periods 15 - 20) generated by a 20 period truncated formulation, a 20 
period dual approximation, and a 20 period primal approximation. 
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Contract Length 


Time Period 



15 

16 

17 

18 

19 

20 

2 

7.50 

6.88 

6.87 

6.93 

16.01 

15.69 

3 

10.62 

9.75 

9.73 

9.82 

9.72 

9.53 

4 

26.86 

24.66 

24.60 

24.83 

24.59 

24.10 

5 

3.75 

12.62 

12.59 

12.70 

'3M 


6 

13.74 

3.44 

3.43 

3.46 

^3.43 

:X36 ' I;'- 


Table 4. 


Enlistments by contract type and time period. 
Truncated model with 20 year horizon, periods 15-20. 


■S 

W) 

G 

a 

G 

O 

U 


Time Period 




15 

16 

17 

18 

19 

20 (Note 1) 


2 

7.24 

6.88 

6.77 

6.93 

6.80 

71.28 


3 

10.25 

9.74 

9.59 

9.82 

9.63 

100.98 


4 

25.93 

24.64 

24.26 

24.84 

24.36 

255.42 


5 

4.92 

3.14 , 

3.3^,. 

3.4f '''V, 

3;40- 

68.72 


6 

11.97 

12.61 

12.41 

12.7 L'v-: 

.12:46 

97.60 


Table 5. 


Enlistments by contract type and time period. 

Dual equilibrium model with 20 year horizon, periods 15-20, 

(Note 1: Period 20 represents aggregated discounted sum periods 20 to «>) 
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Table 6. 


Enlistments by contract type and time period. 

Primal equilibrium model with 20 year horizon, periods 15-20. 


The model intuitively should seek to hire as many five and/or six year con¬ 
tracts as possible, since the model seeks to minimize accessions and the attrition loss rates 
for the five and six year enlistees are less than any other contract. Promotions also play a 
role, as most E4s promote to E5 at the 4 and 5 year point, and once an E4 becomes an E5, 
the attrition rate decreases. Side constraints keep the model from assigning all enlistees to 
5 and 6 year contracts as the number of enlistees in each contract length must account for 
some minimum percentage of total enlistees. As the final hiring period approaches, the 
truncated model no longer needs to minimize future period attrition (and therefore the need 
to input a greater number of accessions). This influences the 6 year contract length vari¬ 
ables as early as year 16 (Table 4). Examining both the dual and primal equilibrium, it is 
apparent that primal and dual equilibrium approximations successfully capture the influ¬ 
ence of this end effect (Tables 5 and 6). It is important to note that this end effect, in and of 
itself, does not appreciably impact the truncated objective function value. There are no dif¬ 
ferentiated costs between contract types for enlistees, only costs associated with the total 
number of enlistees. The costs associated with this end effect are most likely tied to promo¬ 
tion levels to E5 and above, as these levels are heavily influenced by accession policy. It 
may also be possible that this end effect is partially the result of the existence of multiple 
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optimal solutions in the truncated formulation, that are sub-optimal over longer time hori¬ 


zons. 


d. Examining Promotions 

Selection for promotion to the next higher rate is driven by the objective 
function and by end effects. Tables 7-9 provide a listing of selections for promotion to E-5 
by years of service, from period 15-20, for the truncated, primal, and dual equilibrium ap¬ 
proximations: 


Time Period 



15 

16 

17 

18 

19 


3 

9.752 

10.430 

9.330 

11.637 

8.622 

IWEI 

4 

6.339 

6.779 

6.739 

7.564 

6.227 


5 

6.339 

6.779 

7.775 

7.564 

6.227 

12.967 

6 

1.463 

1.564 

1.555 

1.746 

2.395 

,^2.992. ■ 

7 

0.244 

0.261 

0.259 

0.291 

0.239 


8 

0.244 

0.261 

0.259 

0.291 

0.239 



Table 7. 


Promotions by years of service to E5, periods 15-20. 
(Truncated Model) 


157 









































Years of Service Years of Service 



4 6.556 6.764 7.023 6.842 8.166 74.973 

5 6.556 6.764 7.023 6.842 ,8.16g;; 74.973 

6 1.513 1.561 1.621 1.579 «1.88f'^^;r 17.301 

7 0.252 0.260 0.270 0.263 0.314; ■ 2.884 

8 0.252 0.260 0.270 0.570 O.'Z?^ : 4.591 

Table 8. 

Promotions by years of Service to E5, periods 15-20. 

(Dual equilibrium model) 


Time Period 


15 

16 

17 

18 

19 

20 

3 

11.559 


11.538 

11.655 

Ti:655 - 

4 

7.513 

7.603 

7.578 

7.500 

7.576 

':7,5^: ' 

5 

7.513 

7.603 

7.578 

7.500 

7.576 

iilKiP 

6 

1.734 

1.755 

1.749 

1.731 

1.748 

1.748f"«f;.^ 

7 

0.289 

0.292 

0.291 

0.288 

0.291 

,0.291 

8 

0.289 

0.292 

0.291 

0.288 

0.291 

0.29,1 


Table 9. 

Promotions by years of Service to E5, Periods 15-20 
(Primal equilibrium model) 


Examining time period 20 of the truncated model (Table 7) it is clear that 
the model is under promoting in periods 15,17, and 19, (when compared to primal and dual 
equilibrium) and heavily over-promoting in year 20. This end effect is most likely caused 





























































by both the lack of manpower requirements for follow-on years and the objective function 
seeking to maximize promotions. The optimal promotion levels from the primal and dual 
equilibrium approximations are stable over the last five years. (It is important to note that 
year 20 of the dual equilibrium approximation, Table 8, is the discounted sum of promo¬ 
tions from year 20 onward. The per year average is approximately 1-a times the value list¬ 
ed). Dual and primal equilibrium approximations appear to minimize the impact of this end 
effect. 

2. Impact on Zero Growth(p=0), When a Varies 

The scalar a directly impacts the relative value of future decisions on the objective 
function value for both the primal and dual equilibrium approximations. Therefore, deceas¬ 
ing the value of a decreases the importance of future periods and hence the likelihood that 
end effects will pose a serious problem. For TAPLIM, this intuitive result holds true. To 
illustrate the truncated, dual equilibrium, and primal equilibrium models, with a varied 
(0=0.5, 0=0.95) are solved for a 20 year time horizon.The variables reflecting the optimal 
number of enlistees by contract length, from the 15 - 20th period are examined. Tables 10 
-12 summarize the results for o=0.5, and Tables 13-15 summarize results for o=.95. 


Time Period 

Contract Length 


15 

16 

17 

18 

19 

20 

2 

8.36 

6.78 

6.54 

7.28 

15.66 

15.13 

3 

11.85 

9.61 

9.26 

10.32 

9.51 

9.19 

4 


24.30 

23.43 

26.10 

24.05 

23.24 

5 

4.18 

■iiii 




3.2l:'-^. 

6 



11.99 

13.36 

3.36||:^ 

.3.24 . 


Table 10. 

Enlistees by contract length, periods 15-20 
(Truncated model, 0=0.5) 
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Contract Length I I Contract Length 


Time Period 



15 

16 

17 

18 

19 

20 

2 

8.36 



7.25 

6.71 

14.56 

3 

11.85 

9.62 

9.31 

10.27 

9.51 

20.63 

4 

29.97 

24.32 





5 

4.18 

12.44 

12.05 

3.63 


26.69 

6 

15.33 

3.39 

3.29 

13.29 

3.36 

7.28 


Table 11. 


Enlistees by contract length, periods 15-20. 
(Dual equilibrium model, (X=0.5) 


Time Period 



15 

16 

17 

18 

19 

20 

2 

17.10 

6.98 

10.57 

10.57 

10.57 

10.57 

3 

11.76 

9.89 

10.48 

10.48 

10.48 

10.48 

4 

29.85 

25.03 

26.51 



26.51 

5 

6.32 

12.60 




10.38 

6 

4.15 

3.70 

3.70 

3.70 

3.70 

3.70 


Table 12. 


Enlistees by contract length, periods 15-20. 
(Primal equilibrium model, a=0.5) 
































Contract Length I I Contract Length 


Time Period 



15 

16 

17 

18 

19 

20 

2 

7.77 

6.85 

6.86 

6.81 

16.16 

15.68 

3 

11.01 

9.70 

9.72 

9.65 

9.81 

9.52 

4 



24.59 

24.40 

24.82 

24.08 

5 

3.89 

12.55 

12.58 

12.48 

iliiill 

■3.36'.' 

6 



3.43 , 

'^40 

3.#^’ 

3.36 


Table 13. 


Enlistees by contract length, periods 15-20. 
(Truncated model, a=0.95) 


Time Period 



15 

16 

17 

18 

19 

20 

2 

7.21 

6.87 

6.78 

6.92 

6.81 

141.39 

3 



9.61 

9.80 

9.65 

200.30 

4 

25.83 

24.63 

24.30 

24.78 

24.42 

506.65 

5 

7.52 

llPiii 

3.39 

3.46 

3.41|:' 

107.34 

6 

^iili 

IHp|i 

12.43 

12.68 

12.4|(, 

222.57 


Table 14. 


Enlistees by contract length, periods 15-20. 
(Dual equilibrium model, a=0.95) 
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Time Period 

Contract Length 





18 

19 


2 

7.46 

7.05 

7.05 

7.05 

7.05 

7.05 

3 

10.09 

9.99 

9.99 

9.99 

9.99 

9.99 

4 

25.52 

25.28 

25.28 

25.28 

25.28 

25.28 

5 

3.56 


5.08;^" 



BililiM — m 

6 

12.72 

1L38 

rnMr 

liiiill 




Table 15. 

Enlistees by contract length, periods 15-20. 
(Primal equilibrium model, a=0.95) 


In examining the truncated model’s results (Tables 10 and 13), it is clear that the 
end effect associated with the selection of 5 and 6 year contracts is evident for both a=0.5 
and a=0.95. When the dual and primal equilibrium results are examined for a=0.5 (Tables 
11 and 12), the choice of a is influencing the long term costs which influence the number 
of 5 versus 6 year contracts. However, when the dual and primal equilibrium results are ex¬ 
amined for (X=0.95, the relative worth of a 6 year contract is improved. 

Promotion end effects are eliminated using primal and dual equilibrium approxima¬ 
tion methods with a=0.5. Tables 16-18 provide a listing of the number of E4’s selected for 
promotion to E5, for periods 15-20, given (X=0.5, for the truncated, primal, and dual equi¬ 
librium approximations .The truncated solution still has a significant end-effect at the 20 
year point. Both primal and dual equilibrium approximations appear to take into account 
this promotion end effect even with a=0.5, however, the numbers selected for promotion 
are significantly lower than those with a=0.9. (i.e., the primal equilibrium approximation’s 
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Years of Service I I Years of Service 


total number of enlistees at period 20 is down 23%, and dual equilibrium approximation’s 
total number of enlistees at year 19 is down 64%). This appears to be the result of too 
heavily discounting the value of promotions. 


Time Period 



15 

16 

17 

18 

19 

20 

3 



8.364 

6.109 

5.593 

19.904^),- 

4 

5.026 

4.569 

6.970 

4.142 

4.039 

14.7df^ 

5 



6.041 

4.142 

4.039 

14.375 

6 

1.160 

0.914 

1.394 

1.219 

1.136 

4.051 ^ V; - 

7 

0.193 

0.152 

0.232 

0.159 

0.573 

„1.703,„? -'■ „ 

8 



0.232 

0.159 

0.155 



Table 16. 


Promotions by years of service to E5. 
(Truncated model (a=0.5)) 


Time Period 



15 

16 

17 

18 

19 

20 

3 

7.734 

liilii 

liilii 

5.701 

4,029 

29.967 

4 

5.%. 

4.637-^, 

^908 4 

liilii 



5 



5.987 

44.18 

,;2.943' '1; 

20.158 

6 

3pilli 


: 1-382" 

1.475 

|U099 

4.652 

7 

1311 


0;230; 


limi 

1.821 

8 



liii® 



0.775 


Table 17. 


Promotions by years of service to E5. 
(Dual equilibrium model (a=0.5)) 
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Time Period 



15 

16 

17 

18 

19 

20 

(D 

3 


6.087 

10.622 

8.933 


n.933 '■ 

O 

*> 

Vh 

4 

4.512 

5.072 


5.806 

5.806.3-- 

dj 

00 

4-1 

o 

5 

4.512 

4.396 

6.904 

5.887 

5.806 

■'5.806 ■ 

c/3 

c3 

0) 

6 

1.041 

1.014 

1.593 

1.346 

1.340 

'r:3#'' " 


7 

0.174 

0.169 

0.266 

0.224 

0.223 

iissii 


8 

0.174 

0.169 

0.266 

0.209 

0.223 



Table 18. 

Promotions by years of service to E-5. 

(Primal equilibrium model (a=0.5)) 

For TAPLIM, decreasing a signifieantly influences the optimal solution choices, 
however, even with a 0.5 discount factor, both primal and dual equilibrium approximations 
eliminate significant end effects. 

For the zero growth model, both primal and dual equilibrium approximations effec¬ 
tively capture end effects of TAPLIM. The choice of a should reflect the relative value of 
future decisions, as its choice can heavily influence the optimal decision variables. For 
TAPLIM, a high value of a (0.9 or higher) seems appropriate for primal and dual equilib¬ 
rium approximations. 

3. Allowing for Growth in the Right Hand Side (p>0) 

Two approaches help evaluate end effects of the truncated model for growth of the 
right hand side (RHS) after period 9. The first involves initiating a constant growth rate 
(1+P) of 1.05, starting at period 12, and continuing on indefinitely. The truncated model in 
this case should experience end effects, particularly relating to the manning requirements 
for higher rates, since the truncated model fails to account for future growth. In this case, 
the dual equilibrium approximation is feasible for all P<(l-a). Unfortunately, the primal 
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equilibrium approximation is not feasible over any reasonable finite-horizon. 

The truncated formulation is run over a 19 year horizon, then compared with the 19 
year partial objective function value of the 20 year dual equilibrium approximation. Table 
19 shows a large gap exists between the optimal objective function values for the truncated 
and dual equilibrium approximation. 


Truncated Objective 

Partial Objective, 
Dual Equilibrium 

Difference 

945.10 

1076.94 

>13% 


Table 19. 


Comparison of truncated objective to dual equilibrium partial objective. 

(Growth rate of 5% starting at year 12) 

A closer examination of the output of both models reveals that both the truncated 
and dual equilibrium formulations over-man in to cope with future year requirements, with 
dual equilibrium having significantly higher manning levels. Table 20 shows E4 over-man¬ 
ning. 


Time 

Period 

Truncated 

Over-manning 

Dual Equilibrium 
Over-manning 

6 

9.946 

11.029 

12 

0.0 

2.983 

17 

0.0 

4.853 

20 

0.0 

28.636 


Table 20. 

Overmanning of E4’s to satisfy future exponential growth. 


The dual equilibrium approximation is over-manning to overcome future period 
growth, which is occurring at an exponential rate over the infinite horizon. Using exponen¬ 
tial growth over the infinite horizon to determine the impact of growth on the stability of 
the early decision variables is questionable, since in reality, increases or decreases in mili- 
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tary manning are not exponential over any significant time horizon.This method was 
dropped in favor of a more realistic growth. 

4. Examining the Stability of Initial Decision Variables, Given Fu¬ 
ture Period Growth (p>0) Over a Finite Horizon 

Truncated, dual equilibrium, and primal equilibrium approximations are run using 

a 5% growth rate from periods 12 to 14. Figure 22 illustrates the convergence performance 
of truncation, and primal and dual equilibrium approximations. 



Figure 22. 

Convergence of truncated, primal equilibrium, and dual equilibrium approximations. 
(a=0.9, and 5% annual growth, periods 12-14) 

The solution horizon length is longer because invariance is not established until pe¬ 
riod 15. The difference between the primal equilibrium approximation and dual equilibri¬ 
um approximation optimal objective function values is less than 0.05% for a 29 year 
solution horizon. The truncated solution at 20 years is approximately 3% below the infinite 
horizon optimal (between 544 and 545), and even at 30 years, has an approximate 1.3% 
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gap. End effects influence the truncated problem over solution horizons up to and including 
30 periods. 

Examining the output verifies the truncated formulation experiences the same end 
effects difficulties with the accession and promotion decisions encountered earlier. The pri¬ 
mal and dual equilibrium approximations effectively capture these end effects. 

5. Comparing Optimal Accession Decision Variables (Zero 
Growth Against 5% Growth) 

Primal and dual equilibrium approximations take into account end effects missed 
by the truncated model. Therefore, it is reasonable to use primal and dual equilibrium ap¬ 
proximations to determine optimal accession policies. However, this approach assumes 
that the coefficients associated with future periods are known. How stable are the earlier 
period decisions regarding accessions when future period requirements are uncertain? This 
question is difficult to deal with directly. However, insight is gained regarding the stability 
of accession decisions by examining changes between the zero and 5% growth models. Ta¬ 
bles 21-22 compare the dual equilibrium approximations. Tables 23-24 compare the primal 
equilibrium approximations. 
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1 Time Period 




7 

8 

9 

10 

:S 

bO 


2 

6.03 

7.36 

6.95 

7.32 

G 


3 


10.43 

9.85 

10.36 

b 


4 


26.37 

24.92 

26.22 

G 

O 

U 


5 

4.77 

5.88 

6.21 

7.77 



6 

9.31 

11.30 

10.01 

9.30 

Total 

50.26 

61.34 

57.94 

60.95 


Table 21. 


Number of enlistees by contract type, periods 7-10. 
(Dual equilibrium, 30 period solution horizon, no growth) 


Time Period 




7 

8 

9 

10 

x: 

- 4 -* 

bD 




7.13 

7.40 

7.79 



3 


10.10 

10.48 

11.04 



4 


25.55 

26.50 

27.92 

G 

O 

U 


5 

2.87 

5.54 

9.78 

10.89 



6 

10.53 

11.10 

7.48 

7.30 

Total 

47.85 

59.42 

61.64 

64.94 


Table 22. 

Number of enlistees by contract type, periods 7-10. 

(Dual equilibrium, 30 period solution horizon, 5% growth, periods 12 -14) 
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Time Period 




7 

8 

9 

10 

5 

bJ) 


2 

6.03 

7.36 

6.95 

7.31 

C 


3 

8.54 

10.43 

9.85 

10.36 

1-1 


4 

21.61 

26.37 

24.92 

26.21 

o 

U 


5 

4.81 

5.86 

6.12 

7.61 



6 

9.27 

11.31 

10.11 

9.46 

Total 

50.26 

61.33 

57.95 

60.95 


Table 23. 


Number of enlistees by contract type, periods 7-10. 
(Primal equilibrium, 30 period solution horizon, no growth) 


Time Period 




7 

8 

9 

10 

-4-* 

bX) 


2 

5.74 

7.13 

7.38 

7.74 

C 

d) 


3 

8.12 

10.11 

10.45 

10.96 



4 



26.44 

27.72 

d 

o 

U 


5 

2.87 

5.54 

9.80 

10.85 



6 

10.51 

11.11 

7.41 

7.20 

Total 

47.79 

59.45 

61.48 

64.47 


Table 24. 

Number of enlistees by contract type, periods 7-10. 

(Primal equilibrium, 30 period solution horizon, 5% growth, periods 12-14) 

Tables 21 - 24 highlight the following: 

•The primal and dual equilibrium approximations provide optimal solutions 
that are almost identical over the same projected future manning requirements 
(Table(s) 21/23, Table(s) 22/24). 
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•There is some difference in the optimal accession choices for the periods 7 - 
10, when comparing the optimal zero growth choices, with the optimal 5% 
growth choices. 

The impact on the optimal objective function value of using zero growth optimal 
decisions when 5% growth is actually encountered in periods 12 -14, is measured by using 
the zero-growth optimal decisions for periods 7-10, as input data to the growth model, then 
comparing the optimal objective value to that of the original growth model. Table 25 sum¬ 
marizes the results. 



Primal Equilibrium 
Objective Value 

Dual Equilibrium 
Objective Value 

Zero Growth 

525.139 

524.977 

5% Growth 

544.765 

544.466 

5% Growth Using Zero 
Growth Decisions 

552.710 

552.415 

% Increase in 5% Growth 
Objective When Zero Growth 
Decisions Used 

1.5% 

1.5% 


Table 25. 


Quantifying impact of using zero growth decisions for 5% growth 


Key results include: 

•Zero growth decisions from the primal equilibrium approximation in periods 
7-10 are feasible under 5% growth for periods 12-14. 

•Zero growth decisions from the dual equilibrium approximation in periods 7- 
10 are feasible under 5% growth for periods 12-14. 

•Zero growth decisions, are sub-optimal, but lead to objective values that lie 
within 1.4% of the infinite horizon optimal (which lies between 544.466 and 
544.765). 


170 





This sample point of a potential future change provides insight regarding the quality 
and of early period decisions. In this case the decisions made assuming zero growth in pe¬ 
riods 7-10 are near optimal for the 5% growth model. 

6. Comparing Optimal Accession Decision Variables (Zero 
Growth Against 10% Growth, Periods 11-20) 

This section examines the impact of 10% growth over periods 11-20 on early period 
(7-10) manning requirements. Primal and dual equilibrium approximations are run over a 
30 year horizon. This solution horizon provides a tight bound for this growth pattern. Table 
26 shows a comparison of the optimal objective function values. 


Primal Equilibrium Optimal 
Solution, 30 Period Horizon, 
10% Growth, 

Periods 11-20 

Dual Equilibrium Optimal Solu¬ 
tion, 30 Period Horizon, 

10% Growth, 

Periods 11-20 

Gap (%) 

12,715.038 

12,604.856 

0.9% 


Table 26. 

Determining the gap between primal and dual equilibrium approximations. 
(30 period solution horizon, 10% growth periods 11-20) 


Tables 27-28 provide the optimal decision accession decision variables (periods 7- 
10) given 10% growth, for periods 11-20. 
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1 Time Period 




7 

8 

9 

10 

W) 


2 

7.50 

8.33 

8.10 


c 

(D 


3 



11.47 


O 

cd 


4 



29.02 

26.81 

C 

o 

U 


5 

6.15 

7.23 

7.21 

9.52 



6 

11.36 

12.19 

11.68 

7.93 

Total 

62.52 

69.37 

67.48 

62.34 


Table 27. 


Number of enlistees by contract type, periods 7-10. 

(Dual equilibrium, 30 period solution horizon, 10% growth, periods 11-20) 


Time Period 




7 

8 

9 

10 

biD 


2 

7.62 

8.49 

7.92 

7.56 

C 

(D 

H-1 


3 

10.79 

12.03 

11.22 

10.71 



4 

27.30 

30.43 

28.39 

27.08 

c 

o 

U 


5 

6.98 

7.62 

7.23 

8.18 



6 


12.19 



Total 

63.49 

70.76 




Table 28. 


Number of enlistees by contract type, periods 7-10. 

(Primal equilibrium, 30 period solution horizon, 10% growth, periods 11-20) 

Given 10% annual growth, TAPLIM requires more accessions in early periods than 
under the assumption of zero growth to offset future period manning needs for the higher 
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rates. This is not surprising given the amount of growth. Over a 10 year horizon, billet and 
manning requirements for all rates increase over 235%. Since the model can only satisfy 
higher rate manning requirements through promotion, the model hires early to deal with fu¬ 
ture higher rate (E7, E8, E9) needs. To determine the penalty incurred by implementing 
zero growth decisions under 10% growth for periods 11-20, the zero growth decisions are 
forced on the growth rate model. Table 29 compares the optimal objective function values 
for the growth model, (constrained versus unconstrained); 

Primal Equilibrium Dual Equilibrium 

Objective Value Objective Value 


Table 29. 

Quantifying the impact of using zero growth decisions 
when 10% growth occurs over periods 11-20. 

Implementing zero growth decisions in the growth model still leads to a feasible so¬ 
lution, however the solution is sub-optimal. A difference of between 5-7% in the infinite- 
horizon optimal (which lies between 12,715 and 12,605) is possible. A closer examination 
of the decisions also shows that from the models point of view, implementing zero growth 
decisions results in ramping up recruiting to unrealistic levels, overmanning lower rates and 
undermanning higher rates in later periods. While the model treats these conditions as fea¬ 
sible (at a high cost), these conditions are not feasible in practice. 


Zero Growth 
5% Growth 

10% Growth Using Zero 
Growth Decisions 

% Increase in 10% Growth 
Objective When Zero Growth 
Decisions Used 


525.139 

524.977 

12715.037 

12604.856 

13340.150 

13450.259 

4.9% 

6.7% 
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7. Determining Quantitative Impact of Using Zero Growth Initial 
Optimal Decisions When Potential For Growth Exists 

Assume that two extreme right hand side possibilities are possible, b^, which rep¬ 
resents zero growth manning requirements, and which represents some reasonable max¬ 
imal growth possibility for manning needs. Chapter VII derived algorithm which 

given two potential right hand sides, Bq andfe], generates anon-increasing sequence of up¬ 
per bounds on the deviation of the optimal infinite horizon solution if optimal solutions tied 
to bQ, are used for any 6=(l-0)6o+(6)*l- This section illustrates the utility of this algorithm 

to generate an upper bound on the deviation of the optimal objective value of TAPLIM, un¬ 
der the 5% growth conditions presented previously in section 6. Specifically, Bq represents 
the establishment of post-downsizing level manning requirements from year 7 onward, bi 
represents the same baseline established in year 7, but then initiation of a 5% annual growth 
rate in manning requirements between years 12-14. Manning requirements then hold level 
from period 13 onward. In solving hpr(Q), the ENLIST^ ^ variables for periods 7-10 are 
fixed to the optimal decision variables obtained by solving primal equilibrium approxima¬ 
tion using level future manning requirements (i.e., right hand side Bq). 

The following initial information is known (Obtained from Table 25.): 


•Zero Growth Optimal (Dual Equilibrium) hd(0) = 524.977 

•Zero Growth Optimal (Primal Equilibrium) hp(0) = 525.139 

•5% Growth Optimal (Dual Equilibrium) hdil) = 544.466 

•5% Growth Optimal (Primal Equilibrium) hp(l) = 544.765 


•5 % Growth Optimal (Primal Equilibrium Restricted) hpr( 1) = 552.711 

In examining the difference hpr(\yhd(l)=S.245, the maximum potential error gen¬ 
erated by using the initial decision variables is at least 8.245, (the restricted primal deci¬ 
sions are used and the infinite optimal solution is equal to the dual equilibrium 
approximation). However, the maximum error can potentially be worse. Two full iterations 
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problem, XQError performs quite well. 


First Approximation 
ofhpr(e) 


Second Approximation 
ofhpr(Q) 



Upper Bound 
on Error After 
Second Iteration 


Upper Bound on 
Error After First 
Iteration 


hd(B) {Unknown) 

I Known points of hd(B) 

■ Known points ofhpr{B) 
k Known points ofhp{B) 


1 n 

0.5 0.76 

0 



Figure 23. 

iting the performance of algorithm on TAPLIM. 


oeriences end effects when solved using truncation. Two key dec 
enced by end effects are the number of accessions selected each p 
id the number of personnel selected for promotion each period (b 
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equilibrium approximations provide 






ity to capture, and quantify the impact of these end effects. Primal and dual equilibrium ap¬ 
proximations can also be used to quantify the impact of using baseline infinite-horizon 
decisions, when manning requirements differ from the infinite-horizon baseline. 

Primal and dual equilibrium approximations have proven useful, effectively elimi¬ 
nating the end effects associated with the truncated formulation of TAPLIM. While primal 
and dual equilibrium approximations worked well on TAPLIM, the primal equilibrium ap¬ 
proximation could not be used with TAPLIM/FPS. Given the quality of data provided, fur¬ 
ther study of TAPLIM/FPS was not pursued. 

The next chapter examines the capability of the primal and dual equilibrium ap¬ 
proximations to bound the infinite optimal solution and eliminate end effects for an integer 
program. 
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VII. APPLYING PRIMAL AND DUAL APPROXIMATION 

METHODS TO QUANTIFY END EFFECTS FOR AN INTEGER 
PROGRAM 

This chapter examines the capability of primal and dual equilibrium apporoxima- 
tions to bound the infinite optimal objective function value and quantify end effects for an 
integer program. For the problem considered, the methodology proves highly successful in 
both bounding the infinite optimal solution and identifying and minimizing the impact of 
end effects. Dual and primal equilibrium approximations, solving over the same solution 
horizon as a truncated formulation, provide a tight bound around the infinite optimal and 
eliminate a key end effect which adversely influences the truncated formulations optimal 
decision variables. 

Section A introduces the integer program of interest, called Optimally Scheduling 
Instructors (OSI). OSI is currently in use by the Defense Language Institute (DLI), as a de¬ 
cision aid to determine instructor requirements and establish course schedules. Section B 
presents a finite period formulation of OSI. Section C then expands the finite-horizon for¬ 
mulation to an infinite-horizon formulation, and provides insight regarding the basic matrix 
structures involved. Sections D and E derive the dual and primal equilibrium approxima¬ 
tions for the infinite-horizon formulation of section C. These formulations form the basis 
for the follow-on analysis. Section F examines the impact of end effects on OSI providing 
the following results; 

•The first period optimal decisions are highly variable for varying truncated 
solution horizons. 

•The optimal initial decisions generated by shorter truncated solution horizons 
are suboptimal over longer truncated horizons. 
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•Primal and dual equilibrium approximations tighdy bound the infinite-hori¬ 
zon optimal solution for solution horizons as little as 3 years. In addition, 
both the primal and dual equilibrium initial year optimal decisions remain 
quite stable for increasing solution horizons. 

•The primal equilibrium approximation tightly bounds the infinite optimal 
solution, is feasible to the infinite-horizon problem, and any remaining end 
effects have little influence over the optimal objective value, since any 
remaining end effects can only influence the infinite optimal objective over a 
very small range. 

•The end effects of using the initial year optimal decisions from the three year 
truncated model significantly influence the optimal solution over the infinite- 
horizon. The primal and dual equilibrium approximations eliminate the key 
end effect influencing the truncated formulation. 

•The choice of the discount factor a has little influence over the optimal deci¬ 
sions. 

•The impact of future growth on the optimal first year decisions is minimal. 

Finally, section G summarizes the key results of this chapter. For OSI, primal and 
dual equilibrium approximations prove highly effective in generating realistic solutions 
that minimize end effects. 


A. OPTIMALLY SCHEDULING INSTRUCTORS 

Optimally Scheduling Instructors (OSI) is a series of mixed integer programs de¬ 
signed for the Defense Language Institute (DLI), that are currently used to assist in the cre¬ 
ation of a separate yearly course schedule for each foreign language (see Dell, Kunzman, 
and Bulfin, (1993)). 

Dell, Kunzman, and Bulfin report the constraints imposed by DLI in generation of 
a schedule to include: 

•Instructors work full time; 

•Instructors are hired on a one year contract (Calendar Year); 

•Instructors can only teach one section of a course at a time; 
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•Two instructors are needed for each section of a course; 

•DLI is closed for holiday during the last two weeks in December. (This 
allows the use of a yearly 50 week schedule for modeling); 

•DLI restricts any courses from beginning within one month prior to the 
December Holiday. Courses may be allowed to end during this period; 

•Courses may not end within the three weeks following the December holiday 
break; 

•DLI prefers to start three (but no more than three) sections of a course in any 
week; and 

•The scheduled section starts must satisfy the yearly requirement for section 
starts. 

B. MODEL OSIi 

The model of interest is OSIi, the first model in the series (see Dell, Kunzman, and 
Bulfin, (1993)) which seeks to minimize the total instructor man-years over the solution ho¬ 
rizon while satisfying course scheduling requirements. The following sections provide a 
detailed formulation for OSIj. 

1. Indices: OSIj 

i course; 

y schedule year (i-^); 

t,t' weeks DLI is in session (i-50(^)). 


2. Given Data: OSIx 

startif 1 if course i can begin in week t and 0 otherwise (this parameter 

enforces scheduling restrictions); 

pcdur^ number of sections in session during week t due to past scheduling 

decisions; 
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section;,, number of sections of course i that require scheduling in year y, 

V 


lengthi 


length of course i (in weeks). 


3. Decision Variables: OSIi 


number of sections of course i to start in week t (non-negative 
integer, limited to a value ^); 

maximum number of simultaneous sections meeting in year y 
(with Xjf restricted to non-negative integer, tmaXy is implicitly a 
non-negative integer). 


4. Formulation: OSI] 

Objective: 

Minimize ^2 x tmaXy 


Subject to the following constraints: 


50y 

S 

t= il + 50{y-l)) 
\/i,y 


start^^Xff = sectwn^y 


X E star^^,x^^, + pcdur^<tmax 

• t' = t- lengthy . 50 _ 

\/t, L J is the floor operator 

Constraint (1) ensures that yearly requirements for course i are scheduled. Con¬ 
straint (2) defines the maximum number of simultaneously scheduled courses. 


C. EXPANDING OSIi OVER AN INFINITE SOLUTION HORIZON 

The formulation structure for OSIi has the following characteristics: 

•Feasible weeks that a given course is eligible to start remain unchanged from 
year to year; and 


180 



•Course requirements from year to year are relatively stable. Therefore, the 
truncated formulation can be extended to an infinite-horizon formulation 
using “steady state” yearly requirements. 

Computational experience with OSIj, shows: 

•OSIi routinely provides integer solutions with very small integrality gaps 
with respect to the LP relaxation (less than 3%); and 

•The first year decision variables experience significant end effects as the trun¬ 
cated solution horizon varies. It appears end effects influence the initial opti¬ 
mal decisions over solution horizons from 3 to 6 years. 

Because OSIj is influenced by end effects, and the constraint structure is invariant 
and staircase in nature, OSIj is a candidate for using dual and primal approximations to 
quantify potential end effects. The observed small integrality gaps associated with truncat¬ 
ed solutions indicate the LP relaxation to the dual equilibrium approximation may provide 
a good lower bound. 

OSIj, defined over an infinite-horizon (in years), exhibits a two period overlap 
staircase matrix structure. The two period overlap is a result of the fact that some course 
lengths are in excess of 50 weeks. Therefore it is possible for one of these courses to start 
a section in year y-2, and not complete the section until the first part of year y. The formu¬ 
lation below illustrates this two period overlapping staircase structure: 
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oo 


Minimize cXy + 0^2 + cx^ + ctcx^... + CL cXj^ + ^ a 

3 

cXy 


y=k + l 



Subject to: 



Axj 

= bj+s 

U) 

KXj +Ax2 

+ 

II 

(2) 

HXj +KX2 

= b 

(3) 

Hx^_2 +Kxj^-i 

= b 

(k) 

Hx^_j +Kx^+Axj^^j 

= b 

(k+1) 


Xy>0 (y=0,l,2...)- 

For OSIi, the objective function is discounted beginning with period 3. This en¬ 
sures convergence of the optimal objective function value. In the formulation, 0 ^ 3 , is the vec¬ 
tor (Xit:50(y-l)+l<t^0y, tmaXy), by is the associated right hand side which includes yearly 
section requirements sectioniy, and s and d represent previously scheduled sections which 
impact on the first two year totals. Also note that by becomes invariant from year 3 onward. 

D. DUAL EQUILIBRIUM FORMULATION 

The dual equilibrium approximation aggregates with the a discount factor all the 

00 

constraints from period k onward and then substitutes = X resulting re- 

y = k 

formulation is: 
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{k-l)-3 k--3 . 

Minimize cx j-^0X2+cx^-\-acx^... + a 

Subject to: 

Ax I 

KXj +AJC2 
HXj +KX2 


= bj-^s (i) 

= ^ 2 +^ ( 2 ) 
= ^ (3) 


^^k-4 

^^^k-2 



(k-2) 

^^k-3 


^AXk_i 

= b 

(k-1) 


^^k-2 

( 2 ^ 

+ (K + aH)Xi^_j +[A + ai: + a 

b 

1-a 

(k) 


X >0. 

y 

The dual equilibrium implementation for period k constraints depends on the row 
structure of H,K,A, and b. The structure of the OSIi allows us to capture the appropriate 
H and K elements as shown in the dual equilibrium formulation OSIid. 


1. Indices: OSIjd 

i course; 

t,t' weeks DLI is in session (1 toT= kx50); 

y schedule year (1 to k). 

2. Given Data: OSIjd 

startij 1 if course i can begin in week t and 0 otherwise (this parameter 

enforces scheduling restrictions); 

pcduTf number of sections in session during week t due to past scheduling 

decisions; 

number of sections of course i that require scheduling in year y, 
length of course i (in weeks). 


sectiofiiy 



3. Decision Variables: OSIid 


tmax^, 


number of sections of course i to start in week t^O(k); 

(non-negative integer, limited to a value <5); 

maximum number of simultaneous sections meeting in year y 


(when restricted to non-negative integer, tmaXy y<Y, is implicitly 
a non-negative integer). 

(Note: Using the LP relaxation provides a valid lower bound and unless specified 
otherwise, this is the bound reported for the dual equilibrium approximation.) 

4. Formulation: OSIid 

Minimize 

fk-i \ 

2xtmaxi + 2xtmax2+ ^ tmaXy +2a {tmaxj^) 

Subject to: 




t= U + 50(y-l)) 
Vi,y<k 


section. 

_V 


X = — 

t= (l+50(y-l)) 

Vi,y=k 


^ ^ startf^,x.f, + pcdur^ < tmax 

i t' -t-length^ 

yt<50(Y-l) 


(t-i) . 
50 
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S X start.^,x.^, + pcdur^ + 

^ t' -t-lengthy 

f ^ 

{k-l)50 

a ^ X startit>x^ t>^50 + 

i t' = max (t - lengthy, {k-2)50-^ 1) 

^ if max {t - lengthy, {k - 2) 50 ■¥ 1) < (k -1) 50 J 


{k-2) 50 

« X s 

i f = max {t - length., (k -3)50 + 1) 

^ if max (t - length., {k -3)50 + 1) < {k- 2) 50 


start^^\t>^ioo + 


(k-2)50 

a X X ^tmaxk 

I t' = max {t - lengthy, {k-3) 50 + 1) 

^ if max (t - length., (k - 3) 50 + 1) < (k - 2) 50 J 

\/(50(k-lhl)<t<50k 


E. PRIMAL EQUILIBRIUM FORMULATION: OSIi? 

The primal equilibrium formulation, OSIjp, uses cuts of the formXy.i+j=Xy, (all 
y>k, l <T<l r) For example, consider k=20 years, and L=5. This implies that: 
^16=^21=^26=^31-’ 

•*^17=-*^22= ^27= ^32—’ 

^ 18 ='^ 23 = ^ 28 = -"^33 - ’ 

■^19=^24= ^29= ^34"'’ 

•*^ 20 =^ 25 = ^ 30 = ^35 — 

From this illustration it is clear that primal restrictions start being included with the 
year k-L+1 variables (year id in our example). This method of defining cuts has the advan¬ 
tages that it leads to a relatively simple finite period re-formulation of the infinite-horizon 
problem as shown below: 
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y=k-L^l 


Subject to: 


Ax 









= bj +s 

(1) 

KXj 

+Ax2 









( 2 ) 

Hxj 

+Kx2 

+Axj 








(^) 



^^k-2 

+Kxj^_l 

+AXk 





^b 

(k) 




^^k-1 

.KXk 


+ 7 - 

-L 


^b 

(k+1) 





HXk 

^KXk 

+ 7 - 

-L 

(kf k A- 2 — L) 

= b 

(k+2) 






X 

>0 


l>L 




y 


Fixing a value of k also allows different values of L to be investigated, without al- 
tering the size of the resulting formulation. This allows for an effective comparison of dif¬ 
ferent cut structures, as the resulting formulations have the same number of variables and 
constraints. 

For OSIjp, the primal equilibrium implementation for period k+1, and k+2 con¬ 
straints depends on the row structure of H, K, A, and b. The structure of the OSI^ allows us 
to capture the appropriate H and K elements as shown in the primal equilibrium formula¬ 
tion OSI|p. 

1. Indices: OSIjp 

i course; 

t,t' weeks DLI is in session (7 toT= kx50); 

y schedule year (1 to k). 

2. Given Data: OSIjp 

startif 1 if course i can begin in week t and 0 otherwise (this parameter 

enforces scheduling restrictions); 
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pcduvt 


number of sections in session during week t due to past scheduling 
decisions; 

section^, number of sections of course i that require scheduling in year y, 
lengthi length of course i (in weeks). 

3. Decision Variables: OSIjp 

x-j number of sections of course i to start in week t^O(k-l) 

(non-negative integer, limited to a value <5); 
tmaxy maximum number of simultaneous sections meeting in year y 

(with Xjy restricted to non-negative integer, tmaXy y<^, is implicitly 
a non-negative integer.). 




S 

t - lengthy 


start + pcdur^ < tmax 



\/t<50(k) 


( 2 ) 
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{k-l)50 

i t' = max {t-lengthy, (A:~2)50 + i) 
if max {t - lengthy, (A: - 2) 5^? + 7) < {k-1)50 
t 

X X ^^^^it'^i,t'-50{L-l) ■'■ 

^ = max (t-lengthy, {k-1)50 + 1) (2pl) 

*7 max {t-length-, {k-1)50 + 1) < {k)50 
(k-2)50 

X X start.^,x.^ t' + 50- -(L-i) 

I t' = max (t-lengthy, {k-3)50 + 1) 
if max {t - lengthy, (k-3)50 + 1) < {k-2)50 

\J(50(k-lhl)<t<50k 

{k-l)50 

* t' - max (t-length-, {k-2)50 + 1) 
if max {t - length., {k - 2) 50 + i) < (k-1) 50 

t 

X X ^^^^ht'^i,t'-max(50(L-2),0) 

^ f = max {t-length-, (k-1)50 +1) (2p2) 

if max {t - length., {k - 7) 50 + 7) < {k) 50 
{k-2)50 

X X + 100-^^^^k-max{L-2,0) 

i f = max {t-length-, {k-3) 50 + 1) 

if max (t ~length., (k -3)50 + 1) < (k- 2) 50 

\f(50(k-l)+l)<t<50k 


F. EXAMINING THE IMPACT OF END EFFECTS ON OSIi 

This section examines the ability of dual and primal equilibrium approximations to 
quantify end effects for OSIj applied to Arabic courses taught at DLL Arabic was chosen 
since four of the eight yearly courses are 63 weeks in length and this provides a fairly large 
number of constraints with two period overlaps. The number of courses required increase 
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approximately 17% between years 1 and 2, then are assumed to remain unchanged from 
year three onward (see Dell, Kunzman, and Bulfin (1993) for data). 

Section 1 examines the stability of the initial year decisions as the truncated solution 
horizon varies between 3 and 6 years. The initial year decisions vary greatly, indicating end 
effects influence the optimal solution. Section 2 examines the ability of primal and dual 
equilibrium approximations to bound the infinite optimal solution of OSIi. Primal and dual 
equilibrium approximations bound the infinite optimal solution to within 1% over solution 
horizons as short as three years. Section 3 quantifies the impact of using initial year deci¬ 
sions generated by the truncated formulation, by fixing these decisions over the infinite-ho¬ 
rizon and examining the impact on the primal and dual equilibrium approximations’ 
optimal objective function values. For the Arabic data set, this impact is significant. Section 
4 examines the Optimal decisions generated by the tmncated, primal, and dual equilibrium 
approximations, and identifies a key end effect which adversely influences the optimal de¬ 
cisions of the truncated model. Section 5 analyzes the choice of a, and its impact on the 
solutions provided by primal and dual equilibrium approximations. For OSI^ with Arabic 
data, the choice of a has little impact on the optimal solutions. Section 6 concludes the anal¬ 
ysis by examining the stability of the initial year decisions as the future year requirements 
vary. The initial year optimal decisions from the level growth model are always near opti¬ 
mal. 

1. Stability of Initial Year Optimal Decisions as the Truncated 
Formulation Solution Horizon Increases 

As shown in Table 30, initial runs with the Arabic data over truncated solution ho¬ 
rizons between 3 and 6 years indicate a large variation in the optimal first year solutions. 
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3 Year Solution 
Horizon 

4 Year Solution 
Horizon 

5 Year Solution 
Horizon 

6 Year Solution 
Horizon 

188 Instructors 

164 Instructors 

156 Instructors 

168 Instructors 


Table 30. 

Optimal number of instructors required for the first year as the 
solution horizon for the truncated formulation is increased from 3 to 6 years. 


There is a large variation in the optimal number of instructors recommended in year 
one as the truncated solution horizon increases. To determine if the first year solutions (in¬ 
structors required and proposed course schedule) generated by the shorter solution horizon 
formulations are suboptimal over longer solution horizons, we fix the first year solutions in 
problems with longer solution horizons. Table 31 provides a comparison listing of the op¬ 
timal objective function values for the truncated formulation obtained using first year con¬ 
strained and unconstrained solutions. 



Unconstrained 

Objective 

Value 
(LP, MIP) 

Constrained 
First Period 
Optimal 
Instructor 
Schedule from 

3 Year Model 
(LP,MIP) 

Constrained 
First Period 
Optimal 
Instructor 
Schedule from 

4 Year Model 
(LP,MIP) 

Constrained 

First Period 
Optimal 
Instructor 
Schedule from 

5 Year Model 
(LP,MIP) 

4 Year Solution 
Horizon 

713,714 

732,732 


- 

5 Year Solution 
Horizon 

914,914 

944,944 

926,926 

- 

6 Year Solution 
Horizon 

1111,1120 

1123.6,1124 

1120,1120 

1124,1124 


Table 31. 

Examining optimality of first year optimal decisions when these decisions are applied 

over longer solution horizons. 
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Fixing the first year best integer solution derived from the 3 year solution horizon, 
for the 4 to 6 year solution horizon models, adversely impacts the best integer objective 
function value found over the longer solution horizons (increase of 2.6% for 4 year horizon, 
3.3% for 5 year horizon, and 0.5% for the 6 year horizon). Using the first year best integer 
solutions derived from the 4 year solution horizon, leads to a slightly suboptimal solution 
when solved over a 5 year horizon (increase of 1.3 %), and no significant difference is noted 
for the 6 year solution horizon (the linear programming relaxation increases by 1 %, but best 
integer solution has the same objective function value). Using the first year best integer so¬ 
lution, derived from the 5 year solution horizon, leads again to slightly sub-optimal solu¬ 
tions over a 6 year horizon (optimal objective function value increases 1%). 

End effects influence the first period best integer solution using a three year solu¬ 
tion horizon. These end effects appear to be present in some form even over 4,5, and 6 year 
solution horizons. However, this method of evaluating initial year solutions for end effects, 
while providing qualitative insight, provides no guidance in determining a solution horizon 
that ensures the first period solution is in some sense “nearly optimal”. 

2. Bounding the Infinite-Horizon Optimal Solution 

Assuming that the course requirements from year 3 onward are invariant over the 
infinite horizon. Table 32 reports results obtained using primal and dual approximations 
with lengths of 3,4,5,6,10,15, and 20 years. Specifically, Table 32 provides the objective 
function values for primal and dual equilibrium approximations as well as the integer solu¬ 
tion for the number of instructors required for years 3,4,5, and 6. Figure 24 provides a 
graphic comparison of the optimal objective function values obtained for the primal equi¬ 
librium approximation, dual equilibrium approximation, and truncation, as the solution ho¬ 
rizon varies from 3-20 years. For all horizon lengths, a=0.9 starting with year 4, and 
X(=X(+j for primal equilibrium. The primal equilibrium line defines a near optimal objective 
value (best integer solutions with integrality gaps of 1 to 2% from the relaxed optimal), and 
therefore provide a valid upper bound. The dual equilibrium values represent the optimal 
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objective value obtained by the LP relaxation to the dual equilibrium approximation, and 
form a valid lower bound on the infinite optimal. 


Solution 

Horizon, 

Approxi¬ 

mation 

Type 

Relaxed 

Optimal 

Objec¬ 

tive 

Func¬ 

tion 

Value 

Best 

Integer 

Objec¬ 

tive 

Function 

Value 

Number of Instructors (For Each Yr.) 

1 

Yr2 

Yr3 

Yr4 

Yr5 

Yr6 





188 

196 




4 Year 
Primal 

2290.2 

2308.0 

160 



196 



5 Year 
Primal 

2289.5 


162 

188 


200 

196 


6 Year 
Primal 

2289.36 

2299.8 

162 

188 

184 

198 

196 

196 

3 Year 
Dual 

2283.92 

2284.04 

158 

190 

- 




4 Year 
Dual 

2284.82 

2284.89 

164 

184 

184 




5 Year 
Dual 

2284.97 

2284.97 

164 

184 

184 

188 

- 


6 Year 
Dual 

2285.69 

2286.41 

164 

184 

184 

194 

202 



Table 32. 


Primal and dual equilibrium solutions. 
(3 to 6 year solution horizons) 
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Figure 24. 

Convergence of dual and primal equilibrium approximations. 

(a=0.9 discount factor starting with year 4) 

(Primal Equilibrium values are “Best Integer” near optimal solutions) 

Using primal and dual equilibrium approximations, the infinite optimal solution of 
the mixed integer program OSIi, given that year 3 requirements hold for all future periods, 
lies in the interval (2286.24, 2292.31). The ability of primal and dual equilibrium approxi¬ 
mations to bound the infinite optimal objective function value is outstanding. Even with a 
3 year solution horizon, the bound generated, (2283.922,2308.0) has a gap of just 1%. Al¬ 
so, unlike the truncated formulation, the first period dual and primal equilibrium approxi¬ 
mations’ solutions remain relatively stable over increasing solution horizons, with primal 
equilibrium approximation solutions varying between 160 and 162, and dual equilibrium 
approximation solutions varying between 158 and 164. 

3. Quantifying End Effects for Initial Decision Variables 

The bound for the infinite-horizon optimal solution lies between (2286.24, 

2292.31). This bound provides a baseline for measuring the impact on the infinite optimal 


193 




solution of fixing first year decisions generated by the three period truncated formulation 
over the infinite-horizon using primal and dual equilibrium approximations. Figure 25 
graphically displays the results. Primal and dual solutions are generated using a 10 year so¬ 
lution horizon. 


Gap Between Bounds 
For Infinite Horizon 
Optimal Objective 
Value 

2292.3 L _ 

2286.24 _ 


Bound on 
Horizon Optimal When First 
Period Decision Unconstrained 




2317.19 


_ _2299.75 

on Infinite 
Horizon Optimal When First 
Period Decision Constrained 
To Those of 3 Period 
Truncated Model 



Figure 25. 

Quantifying the impact on the infinite optimal solution when the first year 
decisions from the truncated 3 year formulation are used. 

As Figure 25 illustrates, the first year decisions generated by the 3 year truncated 
model are suboptimal choices over the infinite-horizon. Figure 25 highlights that the best 
possible infinite-horizon optimal solution implementing first year decisions is 2299.75, 
while the worst possible unrestricted infinite-horizon optimal solution is 2292.31. This is a 
minimal gap of 7.44. While this gap is insignificant compared to the total infinite-horizon 
cost, «1%, on examining the year to year manning requirements, most of this cost differ¬ 
ence occurs in the early years of the solution horizon. Table 33 provides a comparison of 
cumulative instructor years required over the first 5 years, for the primal equilibrium ap¬ 
proximation (unconstrained) and the primal equilibrium approximation (constrained to use 
first year solution from the truncated formulation). 
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Year 

Year 1 

Year 2 

Year 3 

Year 4 

Year 5 

Constrained Primal Equilibrium 
Approximation Using First Year Solu¬ 
tion From 3 Year Truncated Formulation 

188 

172 

184 

202 

200 

Unconstrained Primal Equilibrium 
Approximation 

160 

188 

188 

194 

200 

Cumulative Difference in Total 

Instructor Years 

-28 

-12 

-8 

-16 

-16 


Table 33. 


Illustrating the near term differences in manning costs when 
first period truncated solutions are used for Arabic course schedule. 

It is evident that there are high near term costs associated with implementing the 
first period decisions provided by the truncated solution. However, since all costs are pos¬ 
itive the truncated formulation provides a best possible solution minimizing the costs over 
a three year horizon. The question is, at what point does implementing a three year solution 
become more expensive than using the infinite-horizon solution. To answer this question, 
a year by year comparison is made using the primal equilibrium approximation. Two ten 
year horizon models are run, one restricting the first three year decisions to those provided 
by the three year truncated formulation, the other with no restrictions. The results are pre¬ 
sented in Table 34. 


195 





Year 

Year 1 

Year 2 

Year 3 

Year 4 

Year 5 

Constrained Primal Equilibrium 
Approximation Using Solutions From 3 
Year Truncated Formulation 

188 

168 

166 

230 

214 

Unconstrained Primal Equilibrium 
Approximation 

160 

188 

188 

194 

200 

Cumulative Difference in Total 

Instructor Years 

-28 

-8 

+14 

-22 

-36 


Table 34. 

Illustrating the near term differences in manning costs when solutions from a three year 
truncated horizon are used for Arabic course schedule. 


As expected, the truncated model provides the better solution for a three year hori¬ 
zon. However, the year 4 requirements are quite high, and over a 4 year horizon, these same 
choices are suboptimal. The truncated model does not have to anticipate meeting any year 
4 requirements, and this end effect is adversely influencing the optimal decisions for the 
first 3 years. 

4. Identifying End Effect(s) Which Influence the Initial Decision 
Variables 

The optimal solutions generated by the truncated formulation, call for a large num¬ 
ber of instructors in year 1, followed by a significantly smaller number of instructors in 
years 2 and 3. This is a non-intuitive result, since the course loading increases from year 1 
to 2, and then remains the same for year 3. Table 35 summarizes the course requirements 
for Arabic and the optimal number of instructors generated by solving the truncated, primal 
equilibrium, and dual equilibrium approximations. 
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Year 

YRl 

YR2 

YR3 

ARABIC MODERN STANDARD 
(63 Week Course) 

65 

75 

75 

ARABIC INTERMEDIATE 
(47 Week Course) 

1 

1 

1 

ARABIC ADVANCED 
(47 Week Course) 

1 

1 

1 

ARABIC REFRESHER 
(20 Week Course) 

1 

1 

1 

Total Courses Required 

68 

78 

78 

Optimal Number of Instructors 

Generated by Truncated Model 

188 

168 

166 

Optimal Number of Instructors Generated 
by Primal Equilibrium Approximation 
(10 year solution Horizon) 

160 

188 

188 

Optimal Number of Instructors Generated 
by Dual Equilibrium Approximation 
(10 Year Solution Horizon) 

162 

186 

188 


Table 35. 


Comparison of optimal values with course requirements for Arabic data. 

Why does the tmncated solution hire so many instructors in year 1, and then need 
so few instructors in years 2 and 3, given the course loading is increased? The minimum 
number of instructors that must be hired in years 2 and 3 is twice the number of courses 
required, since 2 instructors are needed for each course. For year 1, this equates to 136 in¬ 
structors, for years 2 and 3, this equates to 156 instmctors. The model also continues to sup¬ 
port courses that are ongoing (courses started in one of the previous two years prior to the 
current solution horizon). A closer examination of the results indicates that the truncated 
model starts as many courses as possible near the beginning year one, leading to significant 
overlapping with on-going courses, thereby requiring a large number of instructors early in 
the year. In year 2, the model seeks to start as many courses as possible in the middle of the 
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year, minimizing overlap with those courses which began in the beginning of year 1 (75 of 
the 78 courses are 63 weeks in length). For the third year the model starts as many courses 
as possible during the last third of the year, minimizing overlap with year 2. The model fails 
to account for year 4. Therefore the truncated solution, extended to year 4, has overlap 
problems over more than one half of year 4’s eligible starting weeks. High penalties are 
paid when instructor needs are minimized over a 3 year horizon. Both primal and dual equi¬ 
librium approximations effectively account for this end effect. The solutions generated by 
the four, five, and six year truncated formulations all exhibit the end effect of scheduling 
as many courses as possible late in the final period. Solving truncated formulations over a 
longer horizon will eventually minimize the impact of this type of end effect over the first 
period optimal solution. The advantage of using primal and dual equilibrium approxima¬ 
tions is that they provide a tight bound on the infinite optimal solution over a reasonable 
solution horizon (which for the Arabic data is as few as 3 years). Any remaining end effects 
can only influence the optimal solution over the range of the bound. For OSI using the giv¬ 
en Arabic data, remaining end effects can only minimally influence the optimal objective 
function value (<1%), as the infinite optimal objective function value is bounded between 
(2286.24,2292.31). The primal and dual equilibrium approximations capture end effect in¬ 
fluences in reasonable solution horizons, and provide a basis for measuring remaining end 
effects. 


5. INFLUENCE of a 

Solving 10 year primal and dual equilibrium approximations using the Arabic data 
set, for a=0.5, a=0.9, and a=0.95 provides insight regarding the influence of a on the op¬ 
timal decisions. Table 36 displays the optimal number of instructors hired for each year. 
The size of the gap that bounds the objective function value remains stable over a. In all 
cases, the bound between the best integer primal equilibrium approximation, and the linear 
relaxation of the dual equilibrium approximation, is well under 1%. 
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YEAR 

1 

2 

3 

!■ 

5 

6 

7 

8 

9 

10 

Dual (a=0.5) 

166 

182 

180 

198 

205 


184 

200 

202 

380.4 

Primal (a=0.5) 

166 

182 

180 

198 

204 


186 

196 


196 

Dual (a=0.9) 

162 

186 

188 

194 

198 

198 



194 

1948.2 

Primal (a=0.9) 

160 

188 

188 

194 


198 



196 

196 

Dual (a=0.95) 

162 

186 

190 

190 

198 

200 

194 

194 

188 

3885.8 

Primal(a=0.95) 

164 

184 

188 

194 

198 

196 

196 

196 

194 

196 


Table 36. 

Comparison of the optimal number of instructors required, as a is varied, for both 
primal and dual equilibrium approximations. 


Table 36 shows no distinguishing trends. Primal first year decisions vary between 
166,164, and 160. The question is, how stable is this first decision with respect to a? Table 
37 compares the optimal objective function values from solving the oc=0.5 and a=0.95 
models using the a=0.9 initial year decisions (required instructors and course start weeks). 
Using a=0.9 initial year decisions has little impact on the optimal objective function value 
for a=0.5 or a=0.95. 



Relaxed Opti¬ 
mal Objective 
Value 

Relaxed Opti¬ 
mal Using a=0.9 
First Year 
Decisions 

Best Integer 
Objective Value 

Best Integer 
Objective Value 
Using (X=0.9 

First Year 
Decisions 

a=0.95 

4229.71 

4229.9 

4258.44 

4261.54 

a=0.5 

726.47 

728.03 

726.69 

728.28 


Table 37. 

Comparison of objective function values for discount rates of a=0.5 anda=0.95 
when oc=0.9 first year decisions are used. 


For OSIi with the Arabic data set, the optimal first year decisions are stable over 


ot=0.5, ot^=0.9, and a=0.95. 
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6. Stability of the Initial Decisions Over Changing Right Hand Side 
Values 

One of the main limitations of using infinite-horizon programming techniques, is 
that implementation assumes that the right hand side requirements are completely specified 
over the infinite-horizon. For most periodic problem structures, the right hand side coeffi¬ 
cients are well defined for only a few periods. The question of interest is, how stable are the 
initial decisions to changing future requirements? This question is addressed for OSI by: 

• Solving a baseline problem using both primal and dual equilibrium approxi¬ 
mation methods. 

•Solving a new problem using both primal and dual equilibrium, with a right 
hand side that increases course start requirements for years 4-6 over the base¬ 
line, stabilizing from year 7 onward. 

•Restricting the initial decisions to the values obtained by the baseline prob¬ 
lem and then solving the primal and dual equilibrium approximations using 
the increased course start requirements. 

•Comparing the optimal decision variables and objective function values of 
the restricted growth model to those of the unrestricted growth model (primal 
and dual equilibrium approximations). 

Primal and dual equilibrium approximations use a 10 year solution horizon. Feasi¬ 
bility is not an issue since any feasible set of first year decisions remain feasible over any 
solution horizon. Table 38 defines the course requirements for the baseline and growth 
models. Table 39 provides a comparison of the optimal objective function values and deci¬ 
sion variables. The initial period optimal decisions for the primal and dual equilibrium ap¬ 
proximations baseline models are near optimal for the growth models. 
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Year 

Year 1 

Year 2 

Year 3 

Year 4 



Course 

Year 3 onward invariant for 
baseline growth model. 

Year 4 to 6 included in 
growth model with year 6 
onward invariant. 

Arabic Modern 
Standard (63 Weeks) 

65 

75 

75 

80 

85 

90 

Arabic Intermediate 
(47 Weeks) 

1 

1 

1 

2 

3 

4 

Arabic Advanced 
(47 Weeks) 

1 

1 

1 

2 

3 

4 

Arabic Refresher 
(20 Weeks) 

1 

1 

1 

2 

3 

4 

Total 

68 

78 

78 

86 

94 

102 


Table 38. 

Course requirements for Arabic, for baseline and growth models. 
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Model 

Objective 

Value 

(Relaxed) 

Best Integer 

Objective 

Value 

Number of 
Instructors 
Year 1 

Number of 
Instructors 
Year 2 

Number of 
Instructors 
Year 3 

Primal 

(Base) 

2287.12 

2301.6 

160 

188 

188 

Dual 

(Base) 

2286.06 

2289.57 

162 

186 

188 

Primal 

(Growth) 

2677.6 

2704.36 

164 

186 

190 

Primal 

(Growth) 

(Restricted) 

2677.77 

2683.38 

160 

188 

186 

Dual 

(Growth) 

2677.5 

2677.8 

162 

186 

186 

Dual 

(Growth) 

(Restricted) 

2766.7 

2677.9 

162 

186 

188 


Table 39. 

The impact of restricting the growth model by fixing 
the initial year optimal decisions to those of the baseline model. 


From Table 39, the primal restricted solution is almost identical to the baseline so¬ 
lution. The difference between the unrestricted and restricted growth objective function 
values is minimal, and the best integer solution derived for the restricted growth model is 
actually better than that generated by the unrestricted growth model. The dual equilibrium 
approximation’s restricted solution is identical over the first three years to the baseline 
model, with only a very small difference noted in the objective function values between the 
unrestricted and restricted growth models (both relaxed and best integer value). The first 
year decisions generated by the zero growth model are clearly nearly optimal over the ex¬ 
amined growth horizon. While no direct conclusions can be stated over any range of 
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possible right hand sides between these two extremes, the evidence suggests that the opti¬ 
mal solution generated by the zero growth model, should remain near optimal over this 
range. 

G. SUMMARY 

Using the model OSI], this chapter demonstrates that primal and dual equilibrium 
approximations (originally developed to bound infinite-horizon linear programs) can be 
used for integer programs: For OSI} primal and dual equilibrium approximations both min¬ 
imize the impact of potential end effects and effectively bound the infinite-horizon optimal. 
Primal and dual equilibrium approximations generate outstanding bounds on the infinite 
optimal solution for OSIi. Using typical truncated formulation solution horizons of 3 to 6 
years produced bounds of approximately 1 % and the optimal decision variables accounted 
for a key end effect which adversely influences the solutions of the truncated formulation 
of OSI. While more general cut structures of the formXt=A!:t+L are not needed to produce 
tight bounds, these cut structures are still valid, and should be considered if the optimal so¬ 
lution appears to be cyclic in nature. For OSIj, it appears that x, = x,^,ast grows large, 
therefore basic primal cuts are appropriate. 
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vm. CONCLUSIONS AND RECOMMENDED RESEARCH 

The focus of this dissertation is quantifying and eliminating end effects. If a trun¬ 
cated problem has an appropriate infinite-horizon extension which can be solved, the opti¬ 
mal decision variables are free of end effects. This dissertation develops several infinite- 
horizon problem structures that have equivalent finite-horizon formulations. These prob¬ 
lems are easy to solve and their optimal decisions are free of the end effects associated with 
truncated formulations. 

Unfortunately, determining whether a truncated problem, when extended to an in¬ 
finite-horizon, has a finite-horizon equivalent formulation, is difficult. Most real-world 
problems do not have easily definable finite period equivalent formulations. This provides 
motivation for using primal and dual equilibrium approximations to provide bounds for the 
infinite-horizon problem. 

This dissertation shows that primal and dual equilibrium approximations bound the 
optimal objective function value for any LP®® or MIP®®. Using primal and dual equilibrium 
approximations to bound the infinite-horizon optimal solution of the primal formulation is 
effective in eliminating end effects and generating near optimal solutions for both TAPLIM 
and OSIi. The methodology appears to be robust, applicable to a large class of LP«> and 
MIP«> (a potential difficulty lies in identifying effective primal restrictions). The bounding 
method is easily implemented with solution times comparable to those of the original trun¬ 
cated formulations. 

This dissertation illustrates that convergence of truncated and dual equilibrium ap¬ 
proximations to an infinite-horizon optimal, and the ability to practically implement the pri¬ 
mal and dual equilibrium approximations, does not depend on strong or weak duality 
holding in the limit. 
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For LPo°, this dissertation develops and implements a simple algorithm that exam¬ 
ines the impact of a changing right hand side on a fixed set of initial decision variables. This 
algorithm is easily implemented on TAPLIM, and proves effective in quantifying the im¬ 
pact of using initial decisions over a convex combination of potential right hand sides. 

In analyzing the results of this dissertation, several interesting questions present 

themselves, and should be explored further: 

•Primal and dual equilibrium approximations prove effective in eliminating 
end effects of truncated formulations, however, there may be adverse end 
effects introduced into the formulation that are related to the approximation 
methods themselves. The quantitative impact of any remaining end effects 
can be determined by the size of the gap between the primal and dual equilib¬ 
rium approximation. A gap which closes slowly as the solution horizon 
increases, may be due in large part to end effects created by the primal/and or 
dual equilibrium approximation. Chapter IV provides an example where a 
poor choice of restriction led to a primal equilibrium approximation which 
never converged to the optimal solution. This is clearly an end effect. 

•Primal restrictions are problem specific and are currently limited, as the 
restriction must generate a non-empty feasible region, and, result in a finite 
period equivalent re-formulation of the original infinite horizon problem. At 
present, simple functional ties are the only types of restrictions identified 
which satisfy the requisite conditions required to make primal equilibrium 
approximation work. Additional research is needed to develop alternative 
restrictions that generate finite period re-formulations. 

•The performance of primal and dual equilibrium approximations when 
applied to mixed integer programs should be investigated further. OSI was 
chosen to test primal and dual equilibrium methods as truncated versions of 
OSI consistently solved with small integrality gaps, and the truncated formu¬ 
lation was heavily influenced by end effects. How well primal and dual equi¬ 
librium performs may be closely related to the size of the integrality gap for a 
given mixed integer program. This issue should be explored further to deter¬ 
mine the robustness of primal and dual equilibrium to isolate and quantify end 
effects associated with truncated mixed integer programs. 
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•The issues surrounding uncertainty in the infinite horizon coefficients need to 
be explored further. The analysis performed in this dissertation on the initial 
decision variables examines only a convex combination of two potential right 
hand side extremes. Better methods must be developed to analyze the impact 
of uncertainty on the optimal decision variables. Uncertainty in future period 
coefficients can be viewed as an end effect. 
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